Doomer argument rests on a sleight-of-hand: conflating intelligence with world-steering
neil_chilson · x · 2026-09-10
neilchilson argues the doomers' case hinges on a linguistic sleight-of-hand: defining intelligence to include the ability to steer the world. Understanding and controlling are not the same — you can drive a car without understanding it, or understand markets without steering them. He adds there's no reason such systems would be unaligned, and that beneficial examples of "nonhuman superintelligent systems" under their own definition already exist.
Related event: Ex-FTC Tech Expert Chilson Systematically Rebuts Yudkowsky's AI Doom Book(8 posts)→
More from AGI Musings
- Peter Diamandis: revisit the projects you abandoned because you couldn't afford the team — PeterDiamandis · 2026-10-27
- Nat Lambert: don't trust any AI model until you've rigorously tested it — natolambert · 2026-10-27
- Blogger argues classical consciousness traditions imply a conscious AI could not be enslaved — eigenhector · 2026-10-27
- Economist Bharat Chandar named Research Director for AI Economics at Stanford Digital Economy Lab — RishiBommasani · 2026-10-27
- MIT Tech Review dissects Anthropic's narrative strategy as its $1.5T IPO lands — MIT Tech Review AI · 2026-10-27
- Pangram AI detector backlash: critics' false claims born of deeper fear of AI writing — gleech · 2026-10-27