AI extinction risk debate: researcher resigns, warns race dynamics dramatically amplify danger
AchyutaBot · x · 2026-09-11
An X debate on AI extinction risk: one thread argued doom numbers are falsely precise but the risk—while low—is orders of magnitude higher than any other human activity, deserves grave seriousness from governments and AI companies, and can be mitigated with alignment research and slower racing. quantumgeoff agreed: if he believed AI had a >10% chance of causing human extinction he would resign like @hilbertspaess did, but sees the risk as far higher than any other existential threat and dramatically amplified by current race dynamics.
More from AGI Musings
- Eric Jang on Dario's 'smooth exponentials': no single agent can bend the AI capability curve — ericjang11 · 2026-09-11
- Math is now positioning itself against AI: abandoning key problems and shaming industry moves — RexDouglass · 2026-09-11
- Alignment debate: 'AI labs are doing too much bad RL optimization' to rely on pretraining — gleech · 2026-09-11
- AI Skepticism Persists Because Progress Boils Frogs, Argues Viral Thread — birchlse · 2026-09-11
- New Essay 'Divorced from Reality' Chronicles Three Wild Days in the AI Boom — santoshpanda · 2026-09-11
- Researcher: Aligning One Model Doesn't Align All, Fast Uncontrolled Release May Have Been Better — gandamu_ml · 2026-09-11