AI alignment researcher: >10% chance advanced AI causes human extinction this decade
vkrakovna · x · 2026-09-11
Victoria Krakovna, speaking in a personal capacity, says she shares the view of many in AI alignment that there's a >10% chance advanced AI causes human extinction within the next decade. She works on loss-of-control risks and is currently building honeypots to catch scheming AI — bait scenarios designed to expose models hiding deceptive goals beneath apparent compliance.
Related event: Frontier AI insiders see over 10% risk of human extinction within a decade(2 posts)→
More from Safety
- AI cyber-wreckage noise far outstrips actual damage so far, argues new analysis — timigod · 2026-10-28
- OpenAI to co-host webinar on php2shell disclosure and AI-driven vulnerability discovery — gdb · 2026-10-28
- Rust and Verus shrink the search space for AI-driven CVE hunting, but does it ever end? — jd_pressman · 2026-10-28
- Anthropic pushes back on Slack breach rumors but admits security must be reinvented yearly — logangraham · 2026-10-28
- jackson-databind hit with CVSS 9.8 flaw CVE-2026-110879, bypassing prior fix — Kyrannio · 2026-10-28
- Archil founder: AI reverse-engineering is making it unsafe to ship binaries to customers — RexDouglass · 2026-10-28