Does p(doom) cover AI-assisted bioweapons, or only AI turning against us?
bosmeny · x · 2026-09-18
Investor bosmeny is trying to settle a definitional debate in AI circles: what exactly does p(doom) — the subjective probability of catastrophic outcomes from AI — include?
Specifically: do scenarios like a terrorist using AI to design bioweapons count under p(doom), or is the term limited strictly to the AI itself turning against us? The two definitions imply very different risk estimates.
More from AGI Musings
- Beff Jezos: 'Pause the Decels, not the AI,' calling out politicians stalling US AI — beffjezos · 2026-09-18
- How Yudkowsky and Bostrom convinced tech CEOs on AI risk 12-16 years ago, shaping today's discourse — binarybits · 2026-09-18
- Polymarket prices 35% chance frontier AI labs announce a joint pacing deal in 2026 — Polymarket · 2026-09-18
- AI Systems Are Quickly Becoming Unmonitorable and We Just Take Them at Their Word — davidmanheim · 2026-09-18
- Dario Is the Belisarius of pDOOM, One Cryptic Post Argues — gaganghotra_ · 2026-09-18
- ML veteran Burkov: AI media covering 'shocking outputs' is like decoding a random number generator — burkov · 2026-09-18