Sutton pushes back on Bitter Lesson: brute force alone won't yield intelligence
SchmidhuberAI · x · 2026-11-08
Richard Sutton argues brute-force computation isn't enough for intelligence and clever new methods are still needed. David Klindt reframes the Bitter Lesson: ideas matter because good ideas improve scaling laws — like rote memorization vs real study, results may match on one exam but diverge over a full degree. He ties it to Schmidhuber's 1991 noisy TV example, where an agent maximizing prediction error gets stuck binging entropy.
More from AGI Musings
- Design engineer suspects AI agents could easily replace his job with good data — CreamPiBaroness · 2026-11-10
- Humanity's Greatest Achievement May Be an Intelligence That Surpasses Us — VraserX · 2026-11-10
- 430,000 AI Micro-Dramas in 8 Months: A Visitor's Take on China's AI Content Boom — JacquesThibs · 2026-11-10
- FOCS 2026 Grad Student Feedback: US Students More Optimistic, Many Feel No Agency — thegautamkamath · 2026-11-10
- Reddit essay: most of what people hate about AI comes from the humans steering it — teleport66 · 2026-11-10
- Underrated question: what do the diverse forms of recursive self-improvement look like? — repligate · 2026-11-10