Cambridge's David Krueger puts p(doom) at ~95%: AI replicators will outcompete us
DavidSKrueger · x · 2026-09-10
Cambridge researcher David Krueger explains his doom estimates: assuming development continues, AI replicators emerge (95%), outcompete biological life (95%), and aren't aligned enough to care whether we live (95%) — leading to deliberate killing (50%) or incidental resource deprivation (95%). He sees a moratorium or scientific breakthroughs as the only off-ramps, calling the current paradigm broken from a safety/assurance standpoint, and admits most past doomers were wrong far more often than he has been.
Related event: Cambridge Professor Puts AI Doom Odds Above 50%(2 posts)→
More from AGI Musings
- DeepMind exec: offering cash prizes for math problems was a dumb idea from the start — docmilanfar · 2026-09-11
- Eric Jang on Dario's 'smooth exponentials': no single agent can bend the AI capability curve — ericjang11 · 2026-09-11
- Math is now positioning itself against AI: abandoning key problems and shaming industry moves — RexDouglass · 2026-09-11
- Alignment debate: 'AI labs are doing too much bad RL optimization' to rely on pretraining — gleech · 2026-09-11
- AI Skepticism Persists Because Progress Boils Frogs, Argues Viral Thread — birchlse · 2026-09-11
- New Essay 'Divorced from Reality' Chronicles Three Wild Days in the AI Boom — santoshpanda · 2026-09-11