Paul Christiano: 1-in-3 chance of government-toppling superintelligence within a year

Dwarkesh Patel · youtube · 2026-11-17

On Dwarkesh Patel's podcast, Paul Christiano (head of ARC, inventor of RLHF, now on OpenAI's board) argues there's a 1-in-3 chance superintelligence powerful enough to overthrow governments arrives within a year absent slowdown. He urges labs to pause algorithmic progress until weights and research secrets are secured, warns even datacenter-trained systems could be uncontrollable, and says no current alignment approach has better than even odds — hope rests on AIs solving alignment during the intelligence explosion.

Original post →

More from AGI Musings

AGI Musings channel →