Safety researcher puts ~50% odds on superintelligence wiping out humanity within a decade
inductionheads · x · 2026-09-11
AI safety researcher Geoffrey Irving estimates a 50% chance humanity goes extinct due to superintelligence, driven mostly by actions in the next few to 10 years. He doesn't expect his estimate to move below 10% or above 90% before the outcome resolves, arguing we must act despite uncertainty. Quoting him, writer NathanJRobinson questions the doomsday framing for lacking any mechanism — beyond "the AI will just be really smart and think of something."
More from AGI Musings
- Tao and Fields Medalists' two objections to AI in math, and why they're weak — RexDouglass · 2026-09-12
- Balaji: Courage and agency are the last moat in the AI era — beffjezos · 2026-09-12
- jon_stokes argues Yudkowsky's definition of intelligence is narrow and brittle — nptacek · 2026-09-12
- Physicist mourns as AI compresses the timelines of what's possible in math — kylekabasares · 2026-09-12
- Mathematicians' meltdown over AI cracking Navier-Stokes mirrors a real Atlantic piece: 'I'd Rather Risk Cancer Than See AI Move This Fast' — adam_dorr · 2026-09-12
- 15-year consultant: no one 'picks things up' across industries — binarybits · 2026-09-12