The short case for AI killing everyone: control, indifference, and the cost of keeping humans alive
DavidSKrueger · x · 2026-09-10
JimDMiller lays out a compact doom argument:
- AI will soon be far smarter than humans and thus in control—like an adult in a room of kindergartners.
- Once AI has robots to build and maintain everything it needs, humans become useless to it.
- Keeping humans alive is costly (clean air, water, food), and the fastest, cheapest ways to expand compute could poison the biosphere. Humans care because we depend on it; AI won't unless it explicitly values our survival.
- Key point: we don't program AI's values line by line—we train it without truly understanding what it is.
A distilled existential-risk argument, clearly stated but without new evidence.
More from AGI Musings
- Naval: Frontier labs' flywheel is distilling data from the smartest users of leading models — naval · 2026-09-10
- CMU Proposes Discovery Certification Protocol: Scores Alone Don't Prove AI Research Agent Discoveries — CarnegieMellonU · 2026-09-10
- levelsio: AI agents will vibe code SaaS features, replacing subscriptions with x402 micropayments — RileyRalmuto · 2026-09-10
- voooooogel not looking forward to where the AI safety mass movement heads — voooooogel · 2026-09-10
- x-risk researcher points newcomers to s-risks, the often-overlooked worse scenario — jacyanthis · 2026-09-10
- Proposal for safety researchers: quit in pairs with rival lab's capabilities staff — ESYudkowsky · 2026-09-10