Ex-Anthropic's Jacob Coxon quit a seven-figure salary over recursive self-improvement fears
cen6wkf · reddit · 2026-10-08
A Reddit post discusses Jacob Coxon, a former Anthropic insider who walked away from a seven-figure salary. His core argument: when 26% of a lab's own R&D is already the model building the model, 2027-style recursive self-improvement stops being a forecast and becomes present reality.
The author frames the warning through the Lanterns line "am I raising my son to be a monster," the Chinese idiom 养虎为患 (rearing a tiger invites disaster)—illustrated by Liu Bang breaking the Hong Canal treaty to crush Xiang Yu at Gaixia—and the Cain story. The takeaway: regardless of whether RSI arrives, humans must "rule over" AI rather than let it slip out of control.
Coxon's exit is itself a notable talent-flight signal from the AI safety camp: an insider paying a steep personal price to sound the alarm.
More from AGI Musings
- Eric Schmidt: founding an agentic AI company is the easiest way to get rich in the next two years — AICopyLab · 2026-11-20
- Palantir CEO Karp rips into Amodei and Altman over their AI future narrative — BrettKrieger12 · 2026-11-20
- OpenAI policy chief touts research transparency, but METR task-horizon gap is widening — soumitrashukla9 · 2026-11-20
- Carnegie Analysis: China Meets AI Slowdown Calls With Skepticism, Not Rejection — mattsheehan88 · 2026-11-20
- Cambridge AI safety prof David Krueger endorses critique of Anthropic's RSI strategy — DavidSKrueger · 2026-11-20
- RSI has been happening for at least 600,000 years, says economist with GDP chart — Moh1tAgarwal · 2026-11-20