Christiano Now Puts AI Takeover Odds at 1 in 3 Within a Year
PeterBowdenLive · x · 2026-11-20
Paul Christiano's risk estimate has escalated sharply in two months.
- Two months ago he put a 4% chance on AI takeover within 6–12 months. Now he says that on the current trajectory, with no slowdown, there is a 1 in 3 chance of superintelligence powerful enough to overthrow a government within a year.
- Pushed further, he says building as fast and as easily as possible makes AI takeover close to a coin flip within three years, adding that "for most people in this room, the most likely reason they will die is because of an AI accident."
- Zvi notes the shift was "doubtless heavily influenced by what he saw inside OpenAI after joining, not only the METR report."
- Christiano's concrete proposal: labs should pause further algorithmic progress until they can secure model weights and research secrets, otherwise China could steal the superintelligence mid-explosion and labs would lose the ability to slow down even if they saw models going off the rails.
- He also explains how AIs would be trained during the intelligence explosion and why even a system trained entirely inside a data center is risky.
From a Dwarkesh Patel interview.
Related event: Christiano podcast sparks debate after AI takeover odds raised to one-third(4 posts)→
More from AGI Musings
- One Wrong Radiologist Prediction Made Smart People Dismiss All AI Job Displacement — AndyMasley · 2026-11-20
- Erik Brynjolfsson on the Turing Trap: why AI should complement workers, not replace them — erikbryn · 2026-11-20
- Brynjolfsson's GDP-B project proposes new measures of digital-economy well-being — erikbryn · 2026-11-20
- DeepMind projects at least 10x annual growth in effective compute and steeply cheaper cognitive work — dfinke · 2026-11-20
- Researcher flags 'technomoral friction': Claude's firm moral stances vs. humans' face-saving lies — mattbeane · 2026-11-20
- New 79-minute review maps deep learning for gene regulation across cellular contexts, from maxATAC to Bolero — anshulkundaje · 2026-11-20