Ben Todd puts AI existential risk at ~2/3 on current trajectory, 10-35% all things considered
ben_j_todd · x · 2026-10-01
Ben Todd, founder of 80,000 Hours, shares his estimates of existential risk from AI: 2/3 on the current inside-view trajectory, 1/3 with major action, and 10-35% all things considered.
- He sees no route to agents smarter than us that never scheme, nor to containing them if they do — and the enormous care required isn't happening.
- The likeliest bad ending isn't sudden death but rapid loss of human influence, with AIs optimizing the future for resource acquisition or stranger objectives like reward.
- Even with alignment solved, economic and cultural competition at 10-100x speed could disempower most humans and produce an alien economy; locking in power by a small group is another challenge.
- Why not above 2/3: humanity might muddle through; warning shots will likely drive more action.
- Why not below 10%: weak priors like "technology has been good" don't justify low estimates; extreme uncertainty pushes away from extremes.
More from AGI Musings
- DeepMind alignment researcher: frontier labs don't know how to instill values in AI — teropa · 2026-11-16
- AI Futures Project moves superhuman AI researcher forecast up to late 2027 — connoraxiotes · 2026-11-16
- Podcast: Arvind Narayanan on why AI may be a normal technology, not superintelligence — dioscuri · 2026-11-16
- After Teaching 500-1000 People the Terminal, He Says LLM Skeptics Who Don't Build Should Be Doubted — StewartalsopIII · 2026-11-16
- When teams share one AI model, group judgment quietly converges and erodes — DrKavner · 2026-11-16
- Uber earnings: AI agents booked just 4 of ~320M rides in Halloween week — thealexbanks · 2026-11-16