Why accelerate AI if your p(doom) is above zero? A practitioner asks
_arohan_ · x · 2026-09-21
arohan shares a conversation with a non-AI friend who is terrified of AI doom, then poses a pointed question: if your p(doom) > 0, why take part in accelerating research, training data, and training at labs? He concludes most practitioners implicitly assign near-zero doom probability — and challenges them to say so publicly if they truly believe p(doom)=0 for current models.
Related event: The p(doom) Debate: Do Lab Researchers Really Believe in Extinction Risk(8 posts)→
More from AGI Musings
- Agents' bottleneck isn't intelligence but goal commitment — and that's good for alignment — mimi10v3 · 2026-11-12
- Google Cloud survey: 78% say legacy enterprise vendors may not lead the AI era — rseroter · 2026-11-12
- Safety researchers blast OpenAI/Anthropic plan: automating alignment research with possibly misaligned AI — trevposts · 2026-11-12
- NYT essay: resisting Big Tech and AI takes collective action, not willpower — TuhinChakr · 2026-11-12
- Ethan Mollick: 'talk to your documents' RAG solutions already feel dated — emollick · 2026-11-12
- Anthropic's pitch hasn't changed in 5 years: 'AI is winner-take-all, we will build god' — menhguin · 2026-11-12