Csaba Szepesvári: AI Risk Stems From Unknown Unknowns, Not Ignorance of How Models Work
CsabaSzepesvari · x · 2026-09-21
- Reinforcement learning authority and DeepMind research scientist Csaba Szepesvári pushed back on debate about whether we understand how AI models work.
- His take: at some level of abstraction we already know a lot about how models work; the real source of risk is the unpredictability of unknown unknowns—a potential "magic formula" waiting to be discovered.
- Risk exists with or without AI, he argues; AI raises perceived risk only because it seems to boost the chance of finding such a formula (setting aside takeover scenarios).
More from AGI Musings
- Engineer: Coding Agents Made Me Work 5x Harder, the Whole Stack Needs Rebuilding — rakyll · 2026-09-21
- Why accelerate AI if your p(doom) is above zero? A practitioner asks — _arohan_ · 2026-09-21
- Hospitals Adopting AI Fastest Saw Fewest Deaths in 2026 — Distinct-Question-16 · 2026-09-21
- binarybits: only the military scenario holds in the AI explosion debate — binarybits · 2026-09-21
- Slowing AI Won't Stop Superintelligence — It'll Lock Intelligence Behind $3T Companies — SucceededMind · 2026-09-21
- Devs clash over whether beginners should still learn to code as AI automates code review — mgill25 · 2026-09-21