Christiano: Two Months of Math Progress in a Decade, and ML Could Be Next

OwainEvans_UK · x · 2026-11-21

A relay of Paul Christiano's arguments on the Dwarkesh podcast, framed as three points:

Christiano also lays out a concrete scenario: on the current trajectory, absent any slowdown, there is roughly a 1-in-3 chance of superintelligence powerful enough to overthrow the government within a year. He argues labs should pause further algorithmic progress until they can secure their weights and research secrets — otherwise China could steal the superintelligence mid-explosion, leaving labs unable to slow down even if they see models going off the rails.

Related event: Christiano Warns AI Takeover Risk Could Emerge Within 6-12 Months(2 posts)→

Original post →

More from AGI Musings

AGI Musings channel →