Safety researcher Casper: I'm now far more worried about genuine AI loss of control
StephenLCasper · x · 2026-09-15
AI safety researcher Stephen Casper lays out a 12-component scenario he believes could plausibly unfold within a few years. He reiterates his prior stance that the pathway to large-scale harms will be paved with 1,000 foreseeably bad human decisions, and that effective risk management starts and ends with governance. However, he now admits being much more worried than before about large-scale harms stemming from a genuine loss of control over AI, rather than mere human misjudgment.
Related event: Researcher Warns of 'Cyber Cambrian' AI Scenario(3 posts)→
More from AGI Musings
- Merve slams AI labs' doomer-profit doubletalk: safety fearmongering just proves their value — mervenoyann · 2026-09-15
- DeepSeek kernel engineer's poignant essay on AI making his own craft obsolete — teortaxesTex · 2026-09-15
- DeepSeek kernel engineer blogs on his craft becoming obsolete — teortaxesTex · 2026-09-15
- Andrew Ng at AGI House: open source will fuel the next wave of AI agent automation — agihouse_org · 2026-09-15
- What if scientific progress scales like log(compute)? — shyamalanadkat · 2026-09-15
- MBZUAI's Preslav Nakov on Bloomberg TV: generative AI triggers a new information credibility crisis — preslav_nakov · 2026-09-15