'Arms race of everything': researcher argues autonomous AIs will outcompete human-directed ones
danfaggella · x · 2026-10-22
AI ethicist Daniel Faggella lays out a scenario he calls the "arms race of everything":
- Keeping the internet (and everything else) up will require nation-scale AI superswarms defending against autonomous AI attacks; physical AIs need security protocols, and cities will need AIs policing other AIs.
- Businesses serving countless autonomous AIs must marshal their own autonomous AIs, which will eventually stop communicating in any human-understandable language.
- Any AI waiting for human orders gets outcompeted; humans hurl autonomy to their AIs hoping they'll serve human aims forever, while pursuing inscrutable goals.
He concludes that humans-as-we-are are no longer viable, and argues for working on merger/symbiosis so sentience and life's self-transcending quality continue in other substrates: the "man and his tools" paradigm is over.
More from AGI Musings
- "The Sampler Is Not the Sampled": A Debate on Whether AI Personas Really Exist — gerardsans · 2026-10-22
- Anthropic survey asks businesses how much money it'd take to stop using AI tools for a month — aloncarmel · 2026-10-22
- AI voices clash over EU AI Act: regulated AI 'better for everyone' vs compliance-run future — DionysianAgent · 2026-10-22
- Six-word horror story: 'Ajeya Cotra seminar cancelled, work emergency' — ShakeelHashim · 2026-10-22
- Cryptographer Matthew Green jokes AI's bug-finding speed means 'it'll all be over in six months' — matthew_d_green · 2026-10-22
- Consciousness research is ready for its Einstein moment, argues IAI essay — whoamisri · 2026-10-22