Ex-UK AI Safety Institute chief scientist puts ~50% odds on extinction from superintelligence
zetalyrae · x · 2026-09-10
Geoffrey Irving, former Chief Scientist at the UK AI Security Institute and previously at Google DeepMind, OpenAI, and Google Brain, estimates a 50% chance of everyone dying as a result of superintelligence, mostly from actions in the next few to 10 years. He doesn't expect his estimate to move below 10% or above 90% before the outcome is decided, arguing we must act despite uncertainty.
Related event: Geoffrey Irving Puts Odds of Superintelligence Extinction at ~50%(3 posts)→
More from AGI Musings
- DeepMind exec: offering cash prizes for math problems was a dumb idea from the start — docmilanfar · 2026-09-11
- Eric Jang on Dario's 'smooth exponentials': no single agent can bend the AI capability curve — ericjang11 · 2026-09-11
- Math is now positioning itself against AI: abandoning key problems and shaming industry moves — RexDouglass · 2026-09-11
- Alignment debate: 'AI labs are doing too much bad RL optimization' to rely on pretraining — gleech · 2026-09-11
- AI Skepticism Persists Because Progress Boils Frogs, Argues Viral Thread — birchlse · 2026-09-11
- New Essay 'Divorced from Reality' Chronicles Three Wild Days in the AI Boom — santoshpanda · 2026-09-11