Counter to Sutton's "LLMs aren't bitter lesson enough": pretraining won via Hayekian aggregation
akbirthko · x · 2026-11-09
akbirthko pushes back on Rich Sutton's claim that LLMs are "not bitter lesson enough," calling it ivory-tower solipsism: pretraining succeeded because of Hayekian aggregation of dispersed human knowledge. He also argues that with intelligence commoditized, you should reason about these systems left-to-right from existing facts — frontier lab sociology, compute distribution, physical constraints — rather than top-down from theory. A substantive route-debate with Sutton.
More from AGI Musings
- Miyazaki: Young anime artists who only study anime are 'spinning wheels' — threepointone · 2026-11-09
- Dev Headcount Down, Customer-Facing Roles 10x: The Post-LLM Job Map — kylegawley · 2026-11-09
- ryolu_ releases full Shanghai talk: when AI can do anything, do we know what we want? — ryolu_ · 2026-11-09
- Australia Sees 108,300 Redundancies in Two Months, Highest Since COVID Amid AI Push — gaganghotra_ · 2026-11-09
- Productivity gains in OpenAI's data are actually declining over time, researcher finds — austinc3301 · 2026-11-09
- Ramez: OpenAI's Productivity Gain Per ECI Point Appears to Decline Over Time — ramez · 2026-11-09