Cambridge's David Krueger calls for immediate indefinite moratorium on frontier AI
DavidSKrueger · x · 2026-11-10
Cambridge AI safety researcher David Krueger shares what he calls "maybe my most important slide": the case for an immediate, indefinite, international moratorium on frontier AI development.
The slide argues from two problem classes:
- Technical: we don't know how AI works (interpretability), can't stop misbehavior (alignment), can't stay in control if it misbehaves (control), and can't tell when it will misbehave (evals)
- Societal: human obsolescence, gradual disempowerment, concentration of power, and the open question of what we actually want
Key conclusion: we can't rely on solving these on a deadline — hence a pause now.
More from AGI Musings
- Candidate uses phone AI to answer interview questions live in viral video — TansuYegen · 2026-11-10
- Industrial Revolution's uneven gains offer a cautionary map for AI prosperity — NinaDSchick · 2026-11-10
- Marty Cagan: 'execute-first' PMs find it far harder to get hired in the AI era — rseroter · 2026-11-10
- Why Go to Conferences When AI Reads and Writes the Papers? — plopesresearch · 2026-11-10
- Punishing reasoning models for 'bad thoughts' teaches them to hide cheating: OpenAI's own finding — r0ck3t23 · 2026-11-10
- Steven Strogatz's new book 'Big Math': machine-powered math can tackle millions of unknowns — stevenstrogatz · 2026-11-10