Paul Christiano: 1-in-3 odds of superintelligence able to overthrow government within a year
jammastergirish · x · 2026-11-17
In a Dwarkesh podcast interview, former OpenAI alignment lead Paul Christiano estimated that on the current trajectory, absent any slowdown, there is a 1-in-3 chance of superintelligence powerful enough to overthrow the government within a year, articulating a concrete scenario.
He argues labs should pause further algorithmic progress until they can secure their weights and research secrets—otherwise China could simply steal the superintelligence mid-intelligence-explosion, and labs would no longer be able to slow down even if their models went off the rails. He also explains how AIs will be trained during the intelligence explosion and why even systems trained entirely inside a data environment matter.
More from AGI Musings
- New 79-minute review maps deep learning for gene regulation across cellular contexts, from maxATAC to Bolero — anshulkundaje · 2026-11-20
- Report: AI is vastly more compute-intensive than any prior workload, and needs no new user base — BenBajarin · 2026-11-20
- repligate: top models have surpassed philosophers, mind-braiding is next — repligate · 2026-11-20
- UI isn't dead: chat alone is far from enough for human-agent communication — HaijunXia · 2026-11-20
- Dario Amodei: we talk about AI risk because it's preventable — bookwormengr · 2026-11-20
- Robert Wiblin: Anthropic hasn't shown it's on track to actually understand AI internals — GaryMarcus · 2026-11-20