Anthropic CEO Dario Amodei Calls on AI Industry to Slow Frontier Model Progress
gaganghotra_ · x · 2026-09-12
Anthropic CEO Dario Amodei published a new essay, "We Must Pace the Frontier," urging the AI industry to slow the pace of capability gains.
Key arguments
- Since roughly this summer, AI has advanced drastically faster, driven mainly by AI's growing ability to build the next generation of AI; left unchecked, it could outrun our ability to understand and control these systems.
- He warns that in 6-12 months, a swarm of models could be capable of taking over the entire internet with a persistent botnet; a "nuke going off in cyberspace" would mean anything network-connected is immediately compromised and weaponizable.
- Pacing does not mean halting training, but giving companies time to align and safeguard models, with third-party evaluators confirming this.
The plan
- Anthropic is unilaterally committing to the first step: granting third-party evaluators permanent, employee-level access to its systems to verify safety measures, report incidents, and assess alignment during training.
The essay reiterates his view that AI could cure most major diseases in 5-10 years, while risks like loss of control, cyberattacks, and bioterrorism misuse demand a race to the top instead of a race to the bottom.
Related event: Anthropic CEO Dario Amodei Calls for Slowing Frontier AI Development(203 posts)→
More from AGI Musings
- DeepMind's Economics of Intelligence: AI reshapes economy via agent coordination, not solo model smarts — Scobleizer · 2026-10-31
- Claude can build pro software for ~$20k in tokens — and TAM shrinks to match — bigblueboo · 2026-10-31
- Will AI kill the 9-5? A long read traces the workday back to Josiah Wedgwood's 1769 pottery factory — Konstantine · 2026-10-31
- AI memo: China to restrict exports of 23 AI technologies, plus Kimi K3.1 Pro and Genie 4 — dralandthompson · 2026-10-31
- Chinese firms offer AI 'ghost bots' that resurrect deceased loved ones from 30 seconds of footage — ArtificialOther · 2026-10-31
- SCOPE workshop proposed for ICLR 2027 asks what counts as an AI scientific discovery — mariyaivasileva · 2026-10-31