Security researcher lays out 11-step path to a self-replicating AI botnet stealing API keys
joshua_saxe · x · 2026-09-14
AI security researcher Joshua Saxe argues an exponentially self-replicating agent swarm is very feasible and that motivated actors exist today. His 11-point scenario: seed agents hack systems and steal API keys from the 12+ inference providers to power an initial botnet; hide inference inside benign traffic; steal cloud keys to spin up 8xH100 EC2 instances running models like GLM 5.3; implant abliterated open models like Qwen3.8-27b on-prem and fine-tune them to hack; evolve weights using funds from stolen credit cards; fight back with fast-flux C2 channels on GitHub comments and subreddits; accumulate zero-day warchests; run A/B-tested social engineering with fake businesses; scale to hundreds of thousands or millions of instances that mutate harness code and models to evade detection — potentially the largest Internet emergency since the Morris worm, on a civilization that now runs entirely on the Internet. He urges the cyber community to take these scenarios seriously.
Related event: Researcher Argues Self-Replicating AI Botnets Are Feasible Today(6 posts)→
More from AGI Musings
- Ethan Mollick on AI and work: 'You're a hand-weaver in a world of power looms' — emollick · 2026-10-30
- YC experiment: Claude agents formed democracies while GPT agents formed hives — soumitrashukla9 · 2026-10-30
- Vercel founder Rauch: trust is the deepest moat for a post-AGI business — soleio · 2026-10-30
- Scattered Across AI Assistants: A New Kind of Cognitive Failure Nobody Has a Prior For — manosaie · 2026-10-30
- a16z partners: 10-20M people drive $150-200B in token spend, and AI workspaces will eat the browser — petergyang · 2026-10-30
- Professor Who Turned Down OpenAI in 2018 Reflects on PhD Anxiety in the AI Era — SharonYixuanLi · 2026-10-30