Paul Christiano: 1-in-3 chance of government-toppling superintelligence within a year absent slowdown

NathanpmYoung · x · 2026-11-17

Dwarkesh Patel shares key points from his conversation with Paul Christiano: on the current trajectory absent any slowdown, Christiano puts a 1-in-3 chance on superintelligence powerful enough to overthrow the government emerging within a year, articulating a concrete scenario.

He argues labs should pause further algorithmic progress until they can secure weights and research secrets — otherwise a superintelligence could be stolen mid-explosion (e.g., by China), after which labs could no longer slow down even if models went off the rails. He also explains how AIs would be trained during the intelligence explosion and why even systems trained entirely inside a data center pose risks. The attached excerpt shows him carefully noting he isn't speaking as an OpenAI board member.

Related event: Christiano Sees 1-in-3 Odds of Government-Toppling Superintelligence Within a Year(4 posts)→

Original post →

More from AGI Musings

AGI Musings channel →