Rich Sutton: Synthetic Data is a Mistake, Continual Learning is Key
RichardSSutton · x · 2026-08-20
RL pioneer Rich Sutton discusses his core philosophies in a new interview:
- The Bitter Lesson: The world is more complex than any model, so anything trained on human-curated data has a ceiling.
- Continual Learning: Intelligence is continual by definition, yet today's models stop learning the moment they ship.
He also argues that synthetic data is "just a big mistake." The conversation covers common misconceptions about The Bitter Lesson and the achievements of his students, including David Silver, inventor of AlphaGo.
Related event: RL Pioneer Sutton Calls Synthetic Data a Mistake(4 posts)→
More from AGI Musings
- Shogun 2 remaster review-bombed over AI-upscaled graphics, sparking dev debate — draginol · 2026-10-16
- Pedro Domingos: Everyone must have their own unique model, anything else is dangerous — pmddomingos · 2026-10-16
- Interp researcher pushes back: if you can't simulate a neuron, you haven't explained it — nabla_theta · 2026-10-16
- Virtue ethics meets AI alignment: what would it mean to make a model virtuous? — joelbot3000 · 2026-10-16
- Professor: this rec letter season I'm evaluating the student plus Claude — RoozbehMottaghi · 2026-10-16
- Prediction: Riemann Hypothesis likely falls to AI before 2030 — gautamcgoel · 2026-10-16