Scaling in Inference and RL Training Outperforms Pre-training
tobyordoxford · x · 2026-07-03
Toby Ord notes that by standard AI scaling law metrics, current scaling performance is quite solid: halving the error rate in pre-training requires about 1,000,000x the compute. However, on math benchmarks, both inference scaling and RL training deliver logarithmic improvements. This is the most informative post within the same AISecurityInst discussion.
More from Infra
- AI Infra Meme: While Countries Need TW-Scale Power for Datacenters, People Argue About Lightbulbs — mgostIH · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Cloud release velocity scores: AWS 95, Azure 90, Google Cloud 82 — DavidLinthicum · 2026-10-27
- Selling a 5090 to scale local inference: one business weighs 5 hardware paths — Anarchaotic · 2026-10-27
- AWS tutorial: fleet-wide edge CV model lifecycle with SageMaker SDK v3, ~$0.07 per run — AWS ML Blog · 2026-10-27
- Qwen3.8-27B hits 40 tok/s on Jetson Thor with INT4 + MTP, accuracy beats FP16 — No-Dragonfly6246 · 2026-10-27