Ex-DeepMind, now Anthropic researcher: no viable scientific plan for recursively self-improving AI risks
harris_edouard · x · 2026-09-10
A researcher who worked at Google DeepMind and now at Anthropic (writing in personal capacity) says a common sentiment among peers is that there is not yet a viable scientific plan to solve risks from recursively self-improving AI.
Paul Graham shared it, arguing this is why American labs leading is a good thing—employees at Chinese labs couldn't warn about such threats, though Chinese labs will face the same threats within a year, in complete silence.
Related event: Researcher: No Scientific Plan Yet for Recursive Self-Improvement Risk(2 posts)→
More from AGI Musings
- AI folks, stop saying "biology" when you mean drug development — KevinKaichuang · 2026-10-26
- Anthropic's Jascha: you may have only 1–5 years of intellectual contribution before AGI — GabGarrett · 2026-10-26
- Anthropic's S-1 Shows $6.6M Revenue Per Employee as AI Agents Log 6x Human Hours — jacalulu · 2026-10-26
- Ben Recht: The world needs a truly open language model, and it's easier to build than you think — beenwrekt · 2026-10-26
- Which jobs fall to AI first? The rule: any layer whose rules can be written as code — FinanceYF5 · 2026-10-26
- Anthropic S-1: expert-level AI 'within a few years', 90% of code written by Claude — kimmonismus · 2026-10-26