World Models Won't Get Us to AGI — Continual Learning Is the Missing Piece, and It's Hard
Intelligent-Cream-14 · reddit · 2026-09-16
The author argues world models alone won't reach AGI/ASI; continual learning is the only missing piece — and likely far harder than it sounds.
- The update mechanism must be more complex than the model itself: like the brain, it must decide when to update, by how much, and what to forget/merge to free capacity.
- Today's models win via RL on verifiable outcomes, but continual learning is hard to verify — essentially 'RL on an RL algorithm,' possibly stacked many layers deep in human brains, where even reward definitions get updated.
- Practical pain point: three months of tacit experience can't be implicitly inherited by a model; you must write it into prompts, while an average colleague picks it up naturally.
- Verdict: good news that it's the last piece, bad news that solving it may be brutally hard — or force an entirely different path to AGI.
More from AGI Musings
- Benioff: Social Media Was Just the Warm-Up, AI Executives Must Be Held Accountable — TheTuringPost · 2026-09-16
- Privacy scholar Carissa Véliz: the future doesn't get predicted, it gets produced — CarissaVeliz · 2026-09-16
- Dreamforce splits into two camps: Amodei wants to slow AI, Huang to accelerate — kimmonismus · 2026-09-16
- OpenAI's Noam Brown: models' research taste may surpass mine in 1-2 releases — haider1 · 2026-09-16
- OpenAI's Noam Brown: models may beat me at research taste within a release or two — haider1 · 2026-09-16
- Blogger predicts robot revolution and near-ASI by end of next year — flowersslop · 2026-09-16