Sutton's New Lab Bets on Real-Time Learning
burny_tech · x · 2026-07-14
Richard Sutton and Khurram Javed spun off from Keen to found Oak Lab.
They argue that intelligence should primarily come from runtime experience rather than memorizing everything through massive offline pre-training. Based on the big world hypothesis, they believe the world is too vast, making it inherently inefficient to try and learn everything before training.
They are also advancing a batch size one algorithm: the model updates based on single real-time experiences instead of relying on massively curated datasets and huge pre-training compute. The team aims to build a trillion-parameter agent capable of real-time learning and planning within a 20-watt power budget, claiming it could save orders of magnitude in compute and energy compared to existing methods.
Related event: Turing Award Winner Sutton Leaves Keen to Found OakLab(10 posts)→
More from AGI Musings
- IMF says AI could lift Sub-Saharan Africa’s economy by 4% over the next decade — Polymarket · 2026-07-21
- Bluesky’s “AI con” debate is shifting facts while keeping the same tone — iskander · 2026-07-21
- Competition is pushing AI forward faster than ever, the post says — eyishazyer · 2026-07-21
- Why adversaries can make even coin flips predictable — snikolov · 2026-07-21
- Scott Aaronson says AI theorem proofs do not mean P vs NP is around the corner — fortnow · 2026-07-21
- AI makes polished analysis look authoritative, but humans still matter — aloncarmel · 2026-07-21