Ex-Anthropic researcher Jacob Coxon on NBC: recursive self-improvement is the warning sign to watch
rohanpaul_ai · x · 2026-09-11
Jacob Coxon, former Anthropic and OpenAI researcher who resigned, appeared on NBC News to discuss what he sees as the greatest AI risk: recursive self-improvement (RSI).
- Key warning sign: once AI can start making itself better, "the whole thing could go so fast that no one has any chance to control it."
- Research has already changed: he says much of researchers' work is now delegated to AIs assisting AI research — a dramatic shift over the past two years, and a precursor to RSI.
- His call: the public should watch for whether RSI is happening and push for extreme transparency about its extent.
The full interview is on NBC News' YouTube channel.
Related event: Ex-Anthropic researcher warns of recursive self-improvement on NBC(2 posts)→
More from AGI Musings
- Jensen Huang slams ex-Anthropic researcher's warnings as 'outlandish' as generational AI doomerism debate heats up — nptacek · 2026-09-11
- Gary Marcus: 'rationalist' now means believers in an AI ghost story — GaryMarcus · 2026-09-11
- VC challenges OpenAI researcher to bet on humans not going extinct by 2030 — joelbot3000 · 2026-09-11
- Anthropic capabilities employee: AI poses moderate extinction risk — nabla_theta · 2026-09-11
- Anthropic capabilities team member says he joined to reduce AI extinction risk — EigenGender · 2026-09-11
- 'AI Articulates My Views Better Than I Can': Reddit User on Talking with AI — grateful2you · 2026-09-11