Anthropic safety clash: Nathan Calvin publicly challenges Dario over 'racing to the top' strategy
zetalyrae · x · 2026-11-01
Nathan Calvin of AI safety advocacy org Encode is publicly sparring with Anthropic CEO Dario Amodei over whether Anthropic's behavior matches its founding principles.
- Nathan's core claim: Anthropic is racing at breakneck speed toward recursively self-improving superintelligence (RSI), which by its own standards could endanger billions, contradicting its safety commitments.
- Dario's response: the company is following its original "racing to the top" strategy—staying at the frontier while investing heavily in safety research—and has taken competitive hits for safety.
- Nathan concedes Anthropic isn't best modeled as a profit-maximizer but stands by his four key claims.
- The reposter, zetalyrae, argues Anthropic's actions do fit Dario's original strategy, but questions whether that strategy leads to a good outcome for humanity.
More from AGI Musings
- Why honest AI pause advocates ask for 50 years: they want unpredictable new theory — panickssery · 2026-11-01
- Pause advocates pressed: how do you decide AI risk is low enough to resume? — panickssery · 2026-11-01
- Trust Infrastructure Will Matter More Than Benchmarks in the AI Era — AryHHAry · 2026-11-01
- Would a US AI slowdown push marginal researchers to China instead? — dfrsrchtwts · 2026-11-01
- 'You are a subagent': a take on task management in the AI era — lxfater · 2026-11-01
- Robin Hanson: Most people calling to 'pause' AI actually just want to limit it indefinitely — robinhanson · 2026-11-01