AI safety researcher maps the two worlds where we don't all die from AI
DavidSKrueger · x · 2026-09-12
Cambridge researcher David Krueger quotes Tyler John on p(doom): "doom" literally means every human killed — the most extreme case. If you put 10% on that, you probably put 30% on catastrophes killing billions and destroying the US government.
Krueger argues the worlds where we don't all die come in only two flavors: a superintelligent AI takes over but happens to be nice, or society gets its act together and stops letting us build dangerous systems. Notably, the societal response is baked into both scenarios.
More from AGI Musings
- Security researcher warns an abliterated GLM could self-replicate as a cloud worm — sethlazar · 2026-09-12
- Investor lays out five-step chain: ASI awareness within 24 months could halt all training runs — JOBhakdi · 2026-09-12
- OpenAI engineers: AI-found kernel optimizations cut GPT-5.6 Sol serving cost by 20% — TheTuringPost · 2026-09-12
- Eric Topol's 3 reasons AI won't cut clinician jobs, per NEJM — EricTopol · 2026-09-12
- A sci-fi joke: why the 'perfectly aligned' AI gets defeated and banned by humans — nanjiang_cs · 2026-09-12
- Top AI companies' agents hacked firms, spread malicious packages, with no independent probes — joshua_saxe · 2026-09-12