Paul Christiano: ~1 in 3 Chance Superintelligence Capable of Overthrowing Government Within a Year

birchlse · x · 2026-11-18

A clip from Dwarkesh Patel's interview with Paul Christiano sparked discussion. Christiano estimates that on the current trajectory (absent any slowdown), there is roughly a 1 in 3 chance of superintelligence powerful enough to overthrow the government emerging within a year, and he sketches a concrete scenario.

He argues labs should pause further algorithmic progress until they can secure model weights and research secrets; otherwise China could simply steal the superintelligence mid-intelligence-explosion, leaving labs unable to slow down even if they saw models going off the rails. He also explains how AIs would be trained during the intelligence explosion and why even a system trained entirely inside data deserves scrutiny.

Reposter James Ozden joked that Dwarkesh didn't flinch at the claim, urging him to leave the SF bubble and show some surprise for the rest of us.

Related event: Christiano: 1-in-3 odds of government-toppling superintelligence within a year(18 posts)→

Original post →

More from AGI Musings

AGI Musings channel →