Paul Christiano's classic essay resurfaces as ben_j_todd pegs AI existential risk at up to 2/3
ben_j_todd · x · 2026-10-01
benjtodd revisits Paul Christiano's classic short essay What Failure Looks Like, alongside his own existential risk estimates: 2/3 on the current inside-view trajectory, 1/3 with major action, and 10–35% all-things-considered. His reasoning: he sees no route to agents smarter than us that never scheme against us, nor a way to contain them if they do.
More from AGI Musings
- Reddit says AI is fake, Twitter debates whether we survive to 2028 — Puzzleheaded-King584 · 2026-11-16
- Alpha School accused of "counseling out" low-gain students as founders push back on selection bias claims — benjaminjriley · 2026-11-16
- Netflix lands Joseph Gordon-Levitt's AI thriller with Rachel McAdams, sparking debate on AI apocalypse blockbusters — ShakeelHashim · 2026-11-16
- Caine Prize confirms 2026 winner amid AI-use allegations — ShakeelHashim · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16
- A diagram for judging quality in cultural artefacts: coded meaning and exemplary moves — round · 2026-11-16