AI progress is almost entirely digital-only, so extinction risk doesn't add up
JesseDodge · x · 2026-09-10
Part of a thread by Microsoft researcher Jesse Dodge:
- Domains where AI shows fast progress are almost entirely digital-only — coding, math, sandbox escapes all happen on computers; self-driving, robotics, and biology progress slowly over years. To kill humans, AI must affect the physical world.
- Analogy to climate change: it already kills up to millions per year, yet climate scientists' consensus is it isn't an extinction event; AI kills near zero but is framed as one — "the math doesn't add up."
More from AGI Musings
- Apple A20 Pro's 50% memory bandwidth jump is a big deal for on-device multi-agent AI — Scobleizer · 2026-09-10
- 'Culture Is Becoming a Dark Forest': AI Race May Destroy the Knowledge Commons It Built On — erikphoel · 2026-09-10
- Google's Denny Zhou: The Biggest Research Divide Is Access to Top Models and Compute — denny_zhou · 2026-09-10
- Will Automating AI R&D Trigger a Software Intelligence Explosion? Paper Analyzes — nabeelqu · 2026-09-10
- Can Language Models Reproduce Creative Breakthroughs from Historical Data? Scientists Investigate — CatAstro_Piyush · 2026-09-10
- Anthropic's Sholto Douglas on the "Software-Only Singularity" — nabeelqu · 2026-09-10