Rich Sutton: Synthetic Data is a Mistake, Continual Learning is Key
RichardSSutton · x · 2026-08-20
RL pioneer Rich Sutton discusses his core philosophies in a new interview:
- The Bitter Lesson: The world is more complex than any model, so anything trained on human-curated data has a ceiling.
- Continual Learning: Intelligence is continual by definition, yet today's models stop learning the moment they ship.
He also argues that synthetic data is "just a big mistake." The conversation covers common misconceptions about The Bitter Lesson and the achievements of his students, including David Silver, inventor of AlphaGo.
Related event: Rich Sutton: Synthetic Data a Big Mistake, Continual Learning Is the Future(3 posts)→
More from AGI Musings
- Professor urges stopping ChatGPT cheating detection mechanisms — thamar_solorio · 2026-08-20
- Economists Clash Over AI's Economic Impact — erikbryn · 2026-08-20
- Will AI Revolution Match the Internet's Impact on Daily Life? — _N4RuTo · 2026-08-20
- Nobel Laureates and Top Economists Sign Statement Urging Action on AI's Economic Transformation — soumitrashukla9 · 2026-08-20
- Ex-White House Official Launches Center for Technology & Statecraft for Forward-Looking AI Policy — dtompaine · 2026-08-20
- AI shopping hits a reality check, says former Fortune reporter — gerardsans · 2026-08-20