'Mundane doom' argument: even non-extinction AI outcomes are mediocre, so the risk trade is bad
zetalyrae · x · 2026-09-25
A thread on AI risk tradeoffs. One side doubts the claim that 'AIs better than humans at everything → a meaningless world,' noting that's not what EAs want either. The reply offers a 'mundane doom' framing: even the non-extinction outcomes aren't great, which suggests the expected-value calculation of 'accept some extinction risk for utopia' is fundamentally bad and deserves more caution.
Related event: Debate: Even Surviving AI Risk, a Utopia May Cost Human Meaning(4 posts)→
More from AGI Musings
- Investor: Gmail is becoming a dumb pipe for my agents — will Google charge an agent tax? — thechrisperry · 2026-09-25
- Treasury Secretary Bessent: US Needs More Open-Source AI as a Strategic Weapon — rohanpaul_ai · 2026-09-25
- AI shatters dev egos, but nerds will just go deeper down the stack — bendee983 · 2026-09-25
- Why AI writing won't beat humans: writing is anti-inductive and shared models wear out — herbiebradley · 2026-09-25
- New show Airlock asks non-tech people what they think of Dario Amodei — jdjohnson · 2026-09-25
- The PM role is now 3 jobs: AI dissolves barriers between customer, engineering, and business — aakashgupta · 2026-09-25