Scaling in Inference and RL Training Outperforms Pre-training
tobyordoxford · x · 2026-07-03
Toby Ord notes that by standard AI scaling law metrics, current scaling performance is quite solid: halving the error rate in pre-training requires about 1,000,000x the compute. However, on math benchmarks, both inference scaling and RL training deliver logarithmic improvements. This is the most informative post within the same AISecurityInst discussion.
More from Infra
- Resin lets an agent build standalone LLM inference engines; vLLM and SGLang optimize DeepSeek kernels differently — AccBalanced · 2026-10-27
- Local benchmark: Flint matches Qwen3.6 quality at 50/52 while running 3.6x faster on M4 Pro — RichardSocher · 2026-10-27
- Alchemy adds effect/Workflow support across Durable Objects, Workflows and Lambda Durable Functions — samgoodwin89 · 2026-10-27
- Alchemy's Lambda Web Functions run plain Node web servers on Lambda, no OpenNext needed — samgoodwin89 · 2026-10-27
- Alchemy Cuts Cloudflare Bindings CPU Time by Up to 166× Via Profiling — samgoodwin89 · 2026-10-27
- Foldkit Adds SSR Support With a Few Lines of Config on Cloudflare and AWS — samgoodwin89 · 2026-10-27