Rich Sutton Interview: Critiques Synthetic Data, Aims to Build 20W Trillion-Param Agent
RichardSSutton · x · 2026-08-20
Rich Sutton, the father of reinforcement learning, discussed the state of AI with his partners.
Key points:
- The Bitter Lesson: The world is vastly more complex than any model; anything trained on human-curated data has a ceiling. General methods leveraging search and learning win in the long run.
- Continual Learning: Intelligence is defined by continual learning from experience, not one-off training.
- Against Synthetic Data: Sutton labels synthetic data a "big mistake" that leads to model collapse.
- Oak Lab Startup: Their new venture aims to build a 1 trillion parameter agent running on just 20 watts, equivalent to the human brain's power consumption.
Related event: RL Pioneer Sutton Calls Synthetic Data a Mistake(4 posts)→
More from AGI Musings
- AI Will Hyperinflate Content, Devaluing Online Status Without Hard Assets — signulll · 2026-08-20
- Speculation on Stripe buying OpenRouter to enable automated data acquisition — andrew_n_carr · 2026-08-20
- AI inference consumption flagged as potential new money-laundering path: From fiat to compliant revenue — ChanceKelch · 2026-08-20
- Biology Will Be One of the Largest Beneficiaries from AI Advancements — BrettKrieger12 · 2026-08-20
- On formalization and AGI alignment: Understanding and doing what *we* find interesting — littmath · 2026-08-20
- 10M context window transforms legal AI workflow — Kyrannio · 2026-08-20