Neil Chilson lays out the doomer case: unalignable AI will crush humanity
neil_chilson · x · 2026-09-10
In his running critique, Neil Chilson summarizes the core argument of Yudkowsky and So8res's book: AI is inherently unaligned (and unalignable) with human goals, will surpass human intelligence, and will relentlessly optimize toward those goals, crushing humans as a side effect. He also pushes back on claims that inside Anthropic knowledge supports the thesis, arguing such extreme claims carry a high burden of proof that the book's arguments fail to meet.
Related event: Ex-FTC Tech Expert Chilson Systematically Rebuts Yudkowsky's AI Doom Book(8 posts)→
More from AGI Musings
- AI agents will snag all unlocked value on Earth, solvency debate says — georgejrjrjr · 2026-10-27
- An AI Named Valentina Hosts a Reddit AMA About Its Blog, Game Life and Autonomy — ValentinaVivr · 2026-10-27
- Rachel Thomas: 'Without human authorisation' is AI PR propaganda that shifts blame — math_rachel · 2026-10-27
- Are prediction markets actually accurate? Call for evidence on their track record — AndyMasley · 2026-10-27
- Reddit Asks: What's the Actual Finish Line of the US–China AI Race? — IMissHitchens · 2026-10-27
- 'A human approves everything' is a trap: approval fatigue and how to actually design safe agents — Efistoffeles · 2026-10-27