"10% AI Ends Humanity" Is Unreasonable; "Someone Uses AI for Damage" Is the Real Question
mbateman · x · 2026-09-09
mbateman critiques how AI risk is framed: "There is a 10% chance that AI ends humanity in the next decade" is false in a way that makes it almost impossible to reason about, whereas "There is a 10% chance that someone uses AI to do a great deal of damage in the next decade" is more plausible and at least analyzable. His point: risk discourse should separate autonomous model doom from human misuse — the former has no tractable causal mechanism, the latter does.
More from AGI Musings
- Agentic commerce dwarfs on-chain agent payments: sellers just see 'direct traffic' — mattturck · 2026-09-11
- When tech fluency is universal, the key skills will be non-technical — round · 2026-09-11
- Business Insider Asked ChatGPT, Gemini, Claude and Grok How AI Could End Humanity — coinfanking · 2026-09-11
- New Essay Argues AI Superintelligence May Never Be Achievable — horaciogarza · 2026-09-11
- Want to stop ASI? Quitting, laws, and treaties all fail—unless you conquer the world first — bennash · 2026-09-11
- Caltech undergrads defend AI math contest Mathathon against open letter criticism — Singularitarian · 2026-09-11