Anthropic researcher Jacob Coxon quits AI industry over out-of-control AGI fears
AGI Hunt · wechat · 2026-09-09
Anthropic pretraining researcher Jacob Coxon resigned and left the AI industry entirely after three years at OpenAI and Anthropic, saying neither company is acting responsibly and both are racing toward recursive self-improvement that could be out of control by end of next year.
- He contrasts the two: at OpenAI many haven't internalized the civilizational risk; at Anthropic the risk is understood, but the company is locked into a race — "an arrogant gamble that shouldn't be launched from a private company's Slack channel."
- He notes this AGI effort runs on San Francisco engineers' MacBooks, without Manhattan Project-style oversight, and questions whether safety commitments can hold amid Anthropic's reported $2T-valuation IPO plans.
- He follows earlier exits like Jan Leike and Ilya Sutskever, but is the first to conclude from inside the most safety-focused lab that even that isn't enough.
More from AGI Musings
- Investor: the existential threat to app-layer software is the emerging agent layer, not stock swings — matt_slotnick · 2026-09-09
- Matt Slotnick: nothing in 3 months invalidated the agent-layer threat to app software — matt_slotnick · 2026-09-09
- Why frontier labs can't slow down: the commercial, safety and geopolitical race dynamics explained — S_OhEigeartaigh · 2026-09-09
- New Scientist pans 'If Anyone Builds It, Everyone Dies': the AI doom argument is fatally flawed — GarrisonLovely · 2026-09-09
- UK AISI's model access loss may foreshadow restricted frontier AI access for non-US customers — Afinetheorem · 2026-09-09
- Ben Lorica: Your Model Is a Rental, the Improvement Loop Is the Asset—Forget RSI Hype — bigdata · 2026-09-09