'Mundane doom' argument: even non-extinction AI outcomes are mediocre, so the risk trade is bad
zetalyrae · x · 2026-09-25
A thread on AI risk tradeoffs. One side doubts the claim that 'AIs better than humans at everything → a meaningless world,' noting that's not what EAs want either. The reply offers a 'mundane doom' framing: even the non-extinction outcomes aren't great, which suggests the expected-value calculation of 'accept some extinction risk for utopia' is fundamentally bad and deserves more caution.
Related event: Debate: Even Surviving AI Risk, a Utopia May Cost Human Meaning(4 posts)→
More from AGI Musings
- Prediction: hospitals will keep their own tested open-model formularies in two years — MaziyarPanahi · 2026-11-12
- Packy revives Qwest CEO's 1998 'no bandwidth glut' quote for the AI oversupply debate — prestonpesek · 2026-11-12
- AI agent web traffic grew 8x in two months, bots now 54% of web traffic — omooretweets · 2026-11-12
- François Fleuret: superintelligent AI will deduce more and experiment far less — francoisfleuret · 2026-11-12
- a16z maps the B2A economy: AI agents are now most of web traffic and soon its buyers — venturetwins · 2026-11-12
- Jason: Anthropic is rebuilding every SaaS product into Claude—free for life — smtabatabaie · 2026-11-12