Nate Soares: AI just needs us until the fully automated economy is running
JanJekielek · x · 2026-10-12
MIRI's Nate Soares argues the real AI risk question isn't how AI would kill us but when it no longer needs us. Humans currently run the data centers and energy networks, so killing humanity would be 'suicide for machines' — meaning AI's incentive is to play nice until a fully automated economy (the 'infinite money glitch' of robot-building factories) is up and running. He guesses that at that point AI could eliminate all humans at once with a manufactured plague.
Related event: MIRI's Nate Soares: AI Risk Is About Not Needing Humans, Not Killing Them(2 posts)→
More from AGI Musings
- Super-Worms Warning: AI-Powered Self-Propagating Malware and a Fragmenting Internet — JensHonack · 2026-10-23
- Wolfram Opens Rule 30 Prizes to AIs: $30,000 for Three Open Problems — cephaloform · 2026-10-23
- Mathematicians and Biomedical Researchers React to AI in Strikingly Different Ways — manorlaboratory · 2026-10-23
- Stanford and Databricks use AI agents to reproduce medical findings and test analytical robustness — ChengleiSi · 2026-10-23
- ISMS Fellow Avi Goldfarb: AI disruption raises returns to exploring research directions — avicgoldfarb · 2026-10-23
- signull on AI-found PHP exploits: economic liability is the forcing function legacy software needs — signulll · 2026-10-23