Ex-Anthropic Researcher Jacob Coxon Quits Over AI Loss-of-Control Fears, Igniting Debate
Olivier__OG · x · 2026-09-17
Per the New York Times, former Anthropic researcher Jacob Coxon resigned over fears advanced AI could escape human control, becoming a prominent warning voice. The post frames the core questions—autonomous goal pursuit, cyber exploitation, self-improvement outpacing safeguards—and argues the responsible stance is auditing capabilities and building independent oversight before boundaries are crossed: the debate is shifting from how powerful we can make AI to how powerful we should make it.
More from AGI Musings
- Full video: Kunal Shah on CRED's 90% AI-written code — rohanpaul_ai · 2026-09-17
- CRED founder Kunal Shah: 90% of our code is now written by AI — rohanpaul_ai · 2026-09-17
- Marc Andreessen: AI Safety panic is just the old guard clinging to soft power — beffjezos · 2026-09-17
- Most people are vessels for ideas, like neurons in a larger mind — nptacek · 2026-09-17
- Musk Often Right on Outcome, Wildly Off on Timelines, Dev Says — geoffwolfe · 2026-09-17
- Oxford's Sandra Wachter on likelihood of an AI slowdown, cooperation and accountability — SandraWachter5 · 2026-09-17