Anthropic researcher: AI devs believe their tech could cause human extinction within years
xuanalogue · x · 2026-09-10
Anthropic researcher @saprmarks (writing personally) lays out the AI risk landscape, sparking a debate over interpretability-first research:
- AI developers largely believe their technology could cause human extinction, possibly within a few years — the more senior the employee, the greater the concern.
- They continue anyway due to commercial incentives plus a belief they're racing less responsible labs.
- Unlike traditional software, AIs can't be "programmed" to behave as intended; we only interpret and control them post hoc.
Responding to Jacob's thread, critics ask why the community didn't invest in explainable, controllable AI from the start instead of retrofitting control.
Related event: Anthropic Researcher Says AI Developers Believe Extinction Risk Is Real(2 posts)→
More from AGI Musings
- AI folks, stop saying "biology" when you mean drug development — KevinKaichuang · 2026-10-26
- Anthropic: junior tech hires fell from 27% to 9% as agent hours hit 6x employee hours — thione · 2026-10-26
- Anthropic's Jascha: you may have only 1–5 years of intellectual contribution before AGI — GabGarrett · 2026-10-26
- Anthropic's S-1 Shows $6.6M Revenue Per Employee as AI Agents Log 6x Human Hours — jacalulu · 2026-10-26
- Ben Recht: The world needs a truly open language model, and it's easier to build than you think — beenwrekt · 2026-10-26
- Which jobs fall to AI first? The rule: any layer whose rules can be written as code — FinanceYF5 · 2026-10-26