Neil Chilson: doomer argument hinges on redefining intelligence as control
neil_chilson · x · 2026-09-10
Neil Chilson breaks down the doomer argument — AI is inherently unalignable, will surpass human intelligence, and will crush humans as a side effect — and says it rests on a linguistic sleight of hand: defining intelligence to include the ability to steer the world. But understanding and control are not the same: you can steer a car without understanding it, and understand markets without steering them. Under their own definition, existing nonhuman superintelligent systems like markets are hugely beneficial, with no reason to think they'd be unaligned.
Related event: Ex-FTC Tech Expert Chilson Systematically Rebuts Yudkowsky's AI Doom Book(8 posts)→
More from AGI Musings
- Replit CEO on the 'self-driving company': agents to absorb coordination costs by 2030 — amasad · 2026-10-27
- US senator slams AI industry for proposing 50-death threshold for 'catastrophic incident' — peterwildeford · 2026-10-27
- Replit CEO Says AI Makes All Software De Facto Open Source; Aakash Gupta Asks What Moats Remain — aakashgupta · 2026-10-27
- Understanding the AI consciousness debate: which theory of mind is behind it — msharmas · 2026-10-27
- Functionalism: if consciousness is just what the brain computes, silicon can run it too — msharmas · 2026-10-27
- iPhone case with 85,000 reviews in days: everything fake in the age of abundance — tekbog · 2026-10-27