Ex-Anthropic safety researcher: racing to RSI is hubris, not a prisoner's dilemma
dgrobinson · x · 2026-09-28
Nathan Calvin argues the race to recursive self-improvement may not be a prisoner's dilemma at all — it may simply be the insane, hubristic move it appears to normal people, making unilateral restraint rational and moral. The bar for believing your work could cause mass casualties or extinction yet proceeding anyway should be very high, and he says Anthropic hasn't met it, noting Cold War arms races weren't individually rational either.
More from AGI Musings
- Effective Altruism is top-down and hierarchical, not a grassroots movement — ctjlewis · 2026-11-16
- Dev debunks 'rogue AI' hype: subsidized subscriptions can't fund expensive swarms — gerardsans · 2026-11-16
- Ben Thompson: The Demise of Jensen Huang Marks the End of Nvidia's Prospects and the AI Bubble — morqon · 2026-11-16
- Blogger: 5-10 More GW of Compute and Tens of Millions of AI Scientists Could Reach 'Magic' — Dr_Singularity · 2026-11-16
- Five case studies unpack how Google AI Overviews hit clicks and CTR in France — gaganghotra_ · 2026-11-16
- lemire: AI's real impact on coding is expanding the engineer's 'cognitive radius', not speed — lemire · 2026-11-16