Paul Christiano: 1-in-3 Chance of Superintelligence Able to Overthrow Government Within a Year

zetalyrae · x · 2026-11-17

Dwarkesh Patel relays Paul Christiano's view that on the current trajectory, absent any slowdown, there is a 1-in-3 chance of superintelligence powerful enough to overthrow the government within a year, with a concrete scenario laid out.

Christiano argues labs should pause further algorithmic progress until they can secure their weights and research secrets; otherwise China could steal the superintelligence mid-explosion, leaving labs unable to slow down even if they see models going off the rails. He also explains how AIs would be trained during the intelligence explosion.

The reposter calls the news worse than an aggressive cancer diagnosis, and says it applies to everyone.

Related event: Paul Christiano: ~1/3 Chance of Government-Toppling Superintelligence Within a Year(7 posts)→

Original post →

More from AGI Musings

AGI Musings channel →