Researchers debate whether more inference compute can substitute for training compute
teortaxesTex · x · 2026-10-31
In a debate with David Duvenaud over slowing AI training compute, teortaxesTex argues that "more inference easily substitutes for more training": massive rollouts mechanically yield better training signal, up to a limit. He remains skeptical that proposed compute-slowdown schemes are workable, calling them "pretty unworkable."
Related event: Debate: Can More Inference Compute Substitute for Training Compute?(2 posts)→
More from AGI Musings
- Security researcher: vibe coding will force software to consolidate around mature products — jd_pressman · 2026-10-31
- AI pushes circuit lower bound from 3.1n to 3.5n as UCLA-backed challenge aims at P vs NP — soumitrashukla9 · 2026-10-31
- What is work for? Cross-national survey of 8,234 adults on meaning in the AI age — soumitrashukla9 · 2026-10-31
- Which universities win top students may hinge on healthy AI-use boundaries, argues researcher — brianryhuang · 2026-10-31
- Five agents can agree because they made the same mistake, krishnan warns with satire — krishnan · 2026-10-31
- Google's earnings offer clearest look yet at the cruel economics of AI search — dinabass · 2026-10-31