Ex-Anthropic researcher Jacob Coxon on NBC: recursive self-improvement is the warning sign to watch
rohanpaul_ai · x · 2026-09-11
Jacob Coxon, former Anthropic and OpenAI researcher who resigned, appeared on NBC News to discuss what he sees as the greatest AI risk: recursive self-improvement (RSI).
- Key warning sign: once AI can start making itself better, "the whole thing could go so fast that no one has any chance to control it."
- Research has already changed: he says much of researchers' work is now delegated to AIs assisting AI research — a dramatic shift over the past two years, and a precursor to RSI.
- His call: the public should watch for whether RSI is happening and push for extreme transparency about its extent.
The full interview is on NBC News' YouTube channel.
Related event: Ex-Anthropic Researcher Warns NBC of Recursive Self-Improvement AI Risk(3 posts)→
More from AGI Musings
- Almost everyone underestimated AI progress: forecasts off by years on benchmarks and revenue — ben_j_todd · 2026-10-27
- Goldman finds statistically significant negative link between AI adoption and US employment growth — ben_j_todd · 2026-10-27
- a16z: World-changing tech makes a chaotic entrance — AI agents are following the same path — a16z · 2026-10-27
- NEJM AI on medical education: mastery requires performing without the machine — BraydonDymm · 2026-10-27
- Dev warns abliterated models could wreck software supply chains with 1000+ transitive dependencies — nitarshan · 2026-10-27
- Delete your priors: why every SOTA model drop should reset how you think the world works — zack_overflow · 2026-10-27