roon challenges Eric Raymond on AI alignment; ESR fears centralized AI totalitarianism more than rogue AI
tszzl · x · 2026-11-16
Researcher roon (tszzl) respectfully challenged legendary programmer Eric Raymond, saying ESR lacks intuition for the AI alignment problem and inviting him to restate roon's views to locate the disagreement.
ESR pushed back: he does have a clue and agrees with the critique — but he is far more worried about the totalitarian implications of centralized AI control by humans than about rogue AIs. The exchange crystallizes the classic split between technical loss-of-control risk and power-abuse risk in AI safety debates.
More from AGI Musings
- New Interview: Stephen Wolfram on the Ruliad and Why We Can't Predict It — romanyam · 2026-11-16
- Dan Robinson: AI likely able to cause $1T damage before it can fully do your job — austinc3301 · 2026-11-16
- Researcher: model misalignment demos without input info are manipulative or sloppy — giffmana · 2026-11-16
- Researcher calls superintelligence doom scenarios "sci-fi fanfic", argues LLMs can't self-replicate — ziv_ravid · 2026-11-16
- AI Didn't Take Designers' Jobs — It Replaced the CorelDRAW Sign Shop — feregri_no · 2026-11-16
- tszzl fires back at AI risk skeptic: monkeys fear rivals, not autonomous computers — tszzl · 2026-11-16