Anthropic alignment lead: >10% chance AI causes human extinction within a decade
AGI Hunt · wechat · 2026-09-09
After Anthropic researcher Jacob Coxon resigned over AGI extinction concerns, the company's alignment lead Evan Hubinger publicly said "Jacob is right": the team genuinely believes AI could cause human extinction, and he personally estimates the risk within the next decade exceeds 10%.
Hubinger added that Anthropic is working to reduce the risk, but admitted there is no solution yet to the superintelligence alignment problem — and he doesn't think the current path clearly leads to one, saying it's "clearly not on track."
More from AGI Musings
- LukeW: Technology Limits Are Temporary — and AI Skeptics Are Already Feeling It — LukeW · 2026-10-27
- GiveDirectly pilots an optional AI chatbot alongside cash aid in Rwanda — NathanpmYoung · 2026-10-27
- Ex-Anthropic employee essay: the org optimizes for power 'constrained by being seen as the good guys' — RichardMCNgo · 2026-10-27
- Investor: model version numbers are a mirage, only datacenter margins are real — StewartalsopIII · 2026-10-27
- WSJ Op-Ed: For Anthropic Share Offering Investors, a 10% Extinction Chance May Be a 90% Portfolio Win — davidmanheim · 2026-10-27
- WSJ: for Anthropic investors, a 10% extinction chance may still be a 90% portfolio win — peterwildeford · 2026-10-27