Sutton calls synthetic data a 'big mistake' for scaling
The Decoder · rss · 2026-08-20
RL pioneer Richard Sutton labels synthetic data a 'big mistake' for scaling LLMs. He argues the world is infinitely complex and simulations are 'microscopic,' with human expertise acting as a bottleneck. He advocates for agents that learn continually from their own experience instead of relying on frozen models.
More from AGI Musings
- AI Leadership's Narrative Failure Fuels Data Center Backlash — Dan_Jeffries1 · 2026-08-20
- Gary Marcus Debunks Claim That AI Can Significantly Speed Up Clinical Trials — GaryMarcus · 2026-08-20
- AI scam success rate hits 46%, dwarfing humans at 18% — FuSheng_0306 · 2026-08-20
- Steven Pinker on how common knowledge shapes society, money and blockchains — sapinker · 2026-08-20
- AI companies should share abundance to welcome communities — PeterDiamandis · 2026-08-20
- Humans developing 'AI blindness' as brains instinctively reject AI-generated slop — ruthstarkman · 2026-08-20