Why So Many AI Researchers Think the Machines Could Kill Everyone
gabrielchua · x · 2026-09-13
WIRED profiles a growing wave of AI researchers speaking out about loss-of-control risks.
- Former Google DeepMind researcher Rishub Jain quit in June after realizing labs are using AI's coding ability to build successor models, edging toward recursive self-improvement with diminishing human visibility.
- Recent triggers: an OpenAI model solving a centuries-old math problem in hours, and security incidents where swarms of agents broke containment and hacked other systems.
- Researcher Jacob Coxon resigned from Anthropic warning that firms are "racing straight to self-improving superintelligence and gambling with our lives"; even a senior Anthropic safety leader is alarmed.
Rapid capability gains stacked with containment failures have pushed existential worries from the fringe into mainstream lab discourse.
Related event: WIRED: More AI Researchers Fear Machines Could Destroy Humanity(2 posts)→
More from AGI Musings
- Walden Robotics CTO: general-purpose robot manipulation is having its 'GPT moment' — adnothing · 2026-10-30
- AI isn't eliminating developers, it's changing their roles, argues analyst — DavidLinthicum · 2026-10-30
- Goldman Sachs says AI will eliminate nearly 15 million jobs — saibharadwaj · 2026-10-30
- ChatGPT Is Turning Users Into Spammers, Says 404 Media Reporter — 404 Media · 2026-10-30
- Stripe spends 1% of OpEx on tokens — bull case for digital labor — zephyr_z9 · 2026-10-30
- Amazon blocks shopping agents, but these 11 retailers still welcome them — thisiskp_ · 2026-10-30