Creon: algorithmic gains will eclipse hardware improvements — the reverse bitter lesson again
bradneuberg · x · 2026-11-11
Creon argues that between quantization, distillation, sub-quadratic attention, looping, the transformer itself, and future advances, algorithmic improvements will likely eclipse hardware-driven gains — "the reverse bitter lesson, learned many times before." A counterpoint to the current compute-scaling narrative.
More from AGI Musings
- Why 'the next six months will be weird' AI predictions keep falling flat — sebkrier · 2026-11-11
- SimpleBench trend breaks: newest models beat trajectory on common sense — ChrisGPT · 2026-11-11
- AI safety community accused of reputation-driven opinion cascade on thin evidence — sebkrier · 2026-11-11
- Ex-OpenAI policy VP Miles Brundage: METR report redactions hurt public understanding less than claimed — Miles_Brundage · 2026-11-11
- 'Belief in CEV Is Belief in God': A Sharp Jab at Value Alignment Theory — mimi10v3 · 2026-11-11
- A 2035 Scenario: Trillions of AI Agents Do Knowledge Work While Humans Return to Hands-On Life — sebkrier · 2026-11-11