Naval amplifies sharp take: sincere AI doom believers are more dangerous than cynics
naval · x · 2026-09-19
Naval shared @ArtemisConsort's argument: the author, shaped by rationalism/LessWrong/EA, believes AI-safety hardliners genuinely think the entire lightcone is at stake and that controlling AI development requires global governance and a surveillance state. The key claim: a cynical person can be bought off, but a true believer cannot — and their monomaniacal focus leads, via instrumental convergence, to unconstrained power-seeking, for the same reasons they say AGI will be dangerous.
More from AGI Musings
- A kill switch is not a safety architecture: preparing for AI smarter than humans — williamtp · 2026-09-19
- Noam Brown clarifies clip: isolated agents can coordinate with just a few bits — jachiam0 · 2026-09-19
- Robotics AI can't copy the LLM playbook: 5% error rates kill the product — carlosdponx · 2026-09-19
- Anthropic Researcher Quits Over Extinction Risk; Newsletter Writer Pushes Back — alex_verem · 2026-09-19
- The Palantir Frame: Institutional Fitness in the Age of Accelerating AI — curious_vii · 2026-09-19
- Dario Amodei pitches a plan to 'Pace the Frontier' of AI — Nvidia's Huang pushes back — TechCrunch AI · 2026-09-19