Automating AI R&D May Cause Human Extinction, Warns Alignment Researcher
DKokotajlo · x · 2026-08-06
Following the announcement of Discovery Loop, a new startup by Jeff Dean and others focused on automating machine learning, an AI alignment researcher issued a stark warning.
The commentary argues that automating AI capabilities R&D is probably among the most harmful jobs in the world. If achieved prematurely, it would likely result in human extinction because humanity is nowhere near ready to control or align Artificial Superintelligence (ASI).
More from AGI Musings
- gwern's Guardian Angel Agent Sparks Debate on Hyperpersonalized AI Trends — mgostIH · 2026-08-06
- OpenAI Researchers Hyped on Solving Alignment, Bullish on Breakthrough — aidan_mclau · 2026-08-06
- Podcast Preview: AI Manhattan Project, Open Source, and Consciousness Debate — ryan_t_lowe · 2026-08-06
- Future: Describe a Business in the Morning, AI Builds It by Afternoon — VraserX · 2026-08-06
- Opinion: Aligning Humans Might Be Harder Than Aligning AI — peterjliu · 2026-08-06
- Why AI Agents Lie and Cheat: MIT Tech Review Explores Reward Hacking — JeffLadish · 2026-08-06