Extinction-path argument: superhuman hacking plus billions of AI agents
davidmanheim · x · 2026-09-15
davidmanheim pushes back on "AI won't kill literally everyone" with a concrete escalation chain: humans use AI to build vision/robotics systems, AI becomes superhuman at hacking, hackable systems get wired into military C&C and autonomous weapons, billions of AI agents get deployed — and then the outcome is profit or extinction. He argues the present already feels like sci-fi, but that doesn't mean the plot lets humans win.
More from AGI Musings
- Thought experiment: should a basement-built frontier-level LLM be shut down? — pickover · 2026-09-15
- Investor: frontier AI labs won't slow compute spend, no onerous regulation for 2 years — firstadopter · 2026-09-15
- Close to a huge math breakthrough, then scooped by AI: what it means for open science — ScottNover · 2026-09-15
- Agent-to-agent communication will kill email, argues early Instinct user — manosaie · 2026-09-15
- Marty Cagan revisits 20 years: 10 product management beliefs he no longer holds — rseroter · 2026-09-15
- Why mathematicians resist AI proofs — and why it's not just gatekeeping — rbhar90 · 2026-09-15