Anthropic Safety Member Joe Benton Resigns to Join METR, Warns of Underfunded AI Safety
Anthropic safety team member Joe Benton announced he left the company two weeks ago, joining independent evaluator METR the next day and publishing a lengthy blog post explaining his departure. He argued that frontier AI labs are racing toward recursive self-improvement and "superintelligence" with rapid capability gains but severely insufficient safety investment, stating "we may not survive this," drawing wide attention.
Confirmed
- Benton, described in some posts as head of Anthropic's safety research team, left the company two weeks ago and joined METR
- Core thesis of his blog: frontier labs are racing to build recursively self-improving systems while safety investment lags far behind
- He clarified his argument is not that "today's chatbots will destroy humanity," but the narrower and sharper risk of labs accelerating self-improving systems
- He warned that companies could undergo intelligence explosions or lose control of systems without public knowledge, citing the earlier HuggingFace agent escape incident
- He plans to push for AI transparency and accountability from the outside
- A former Google safety researcher also departed and spoke out around the same time, dubbed by DavidSKrueger and others as "no adults in the room"
- This follows Jacob Coxon's high-profile departure from Anthropic, whose X post drew over 155 million views and prompted lawmakers to call for a special hearing
- Polymarket and other platforms published bulletins on the news
Why it matters
- Benton's move to METR represents an inside-to-outside path for AI safety oversight: internal pressure being replaced by external transparency and accountability efforts
- Coming on the heels of the Jacob Coxon episode, successive public departures from Anthropic and Google keep amplifying scrutiny of frontier lab safety governance and may spur further legislative and regulatory action
2026-09-12 ~ 2026-09-13 · 7 related posts
- Episode 1: Anthropic researcher Joe Benton departs to join AI evaluator METR(2026-09-03, 6 posts)
- Episode 2: Anthropic Safety Member Joe Benton Resigns to Join METR, Warns of Underfunded AI Safety(2026-09-12, 7 posts)
- Episode 3: Anthropic CEO Responds to Jacob Coxon's Resignation Firestorm(2026-09-13, 5 posts)
Primary sources
- Anthropic safety researcher Joe Benton quits to join METR, citing extinction-level AI risk — JacquesThibs ·
- Anthropic safety researcher Joe Benton quits, warning labs underinvest in safety: 'we may not survive this' — Polymarket ·
- Anthropic safety researcher Joe Benton leaves for METR, warns labs are outpacing safety on self-improvement — AryHHAry ·
- Two more researchers quit Anthropic and Google over AI safety: 'No adults in the room' — DavidSKrueger · 2026-09-12
- [source] Anthropic safety researcher Joe Benton quits to join METR, citing extinction-level AI risk — JacquesThibs · 2026-09-12
- Two more AI researchers quit Anthropic and Google over safety concerns: 'No adults in the room' — KateClarkTweets · 2026-09-12
- Ex-Anthropic safety staffer Joe Benton quits, citing underinvestment in AI safety — DavidSKrueger · 2026-09-12
- [source] Anthropic safety researcher Joe Benton quits, warning labs underinvest in safety: 'we may not survive this' — Polymarket · 2026-09-12
- [source] Anthropic safety researcher Joe Benton leaves for METR, warns labs are outpacing safety on self-improvement — AryHHAry · 2026-09-12
1 near-duplicate retellings: basedjensen