Reason Review Slams Yudkowsky's AI Doom Book: Extraordinary Claims, No Evidence
neil_chilson · x · 2026-09-10
Neil Chilson reviews Yudkowsky and Soares's new book If Anyone Builds It, Everyone Dies in Reason magazine.
Key points:
- The claim that superintelligence will inevitably kill everyone requires extraordinary evidence, but the book offers only a daisy chain of thought experiments, unexamined premises, and a linguistic sleight of hand.
- The argument rests on the alignment problem: AI is "grown" via training, so its goals can't be fully specified; any slight divergence from human values leads to relentless optimization and human elimination.
- Chilson argues the authors' blindness to real-world complexity yields only despair, ignoring how intelligence-augmenting tools could deliver widespread, unprecedented prosperity.
- Their proposal effectively amounts to outlawing promising AI progress.
Related event: Ex-FTC Tech Expert Chilson Systematically Rebuts Yudkowsky's AI Doom Book(8 posts)→
More from AGI Musings
- All 8 Transformer paper authors left Google, and rival labs captured most of the frontier value — signulll · 2026-10-27
- Anthropic's S-1 pledges AI for curing diseases and serving 4.6B underserved patients — petergyang · 2026-10-27
- Goldman finds statistically significant negative link between AI adoption and US employment growth — ben_j_todd · 2026-10-27
- a16z: World-changing tech makes a chaotic entrance — AI agents are following the same path — a16z · 2026-10-27
- NEJM AI on medical education: mastery requires performing without the machine — BraydonDymm · 2026-10-27
- Dev warns abliterated models could wreck software supply chains with 1000+ transitive dependencies — nitarshan · 2026-10-27