Sutton's New Lab Bets on Real-Time Learning
burny_tech · x · 2026-07-14
Richard Sutton and Khurram Javed spun off from Keen to found Oak Lab.
They argue that intelligence should primarily come from runtime experience rather than memorizing everything through massive offline pre-training. Based on the big world hypothesis, they believe the world is too vast, making it inherently inefficient to try and learn everything before training.
They are also advancing a batch size one algorithm: the model updates based on single real-time experiences instead of relying on massively curated datasets and huge pre-training compute. The team aims to build a trillion-parameter agent capable of real-time learning and planning within a 20-watt power budget, claiming it could save orders of magnitude in compute and energy compared to existing methods.
Related event: Turing Award Winner Sutton Leaves Keen to Found OakLab(10 posts)→
More from AGI Musings
- Economist Ben Moll: You Can Model Anthropic's 15% AI GDP Growth, But It Won't Happen — sebkrier · 2026-09-11
- Cohere Labs launches interactive tool mapping which tasks of 178 occupations AI can automate — Cohere_Labs · 2026-09-11
- AI researcher on SkyNews flags concerns over inequality, power and criminal misuse — schwarzjn_ · 2026-09-11
- VC compares AI doom rhetoric to pandemic-era fear messaging — StewartalsopIII · 2026-09-11
- Anthropic Insiders: Not Everyone at the Lab Believes in High p(doom) — anpaure · 2026-09-11
- Could 10k agents discover learning methods beyond backprop, or just tweak existing ones? — SeunghyunSEO7 · 2026-09-11