Why people stay at AI labs despite believing in ~10% extinction risk: three rationales and a void of meaning
sebkrier · x · 2026-09-10
Jasmine Sun lays out three reasons people keep working at AI labs while believing extinction risk is around 10%: techno-determinism (someone will build ASI anyway, better I do it safely), consequentialism (utopia vs doom makes it a +EV bet), and self-interest (fun, money, friends). She notes nobody admits hyping risk for marketing—people genuinely believe it while compartmentalizing. Quoted scholar ScholarsStage adds a rarely articulated driver: the work fills a void of meaning, echoing the psychology of past revolutionaries who saw themselves as agents of history.
Related event: Why AI Researchers Stay Despite Believing Extinction Risk(3 posts)→
More from AGI Musings
- Tyler Cowen to AI doomers: why not take asset positions that only pay off if you're dead — shakoistsLog · 2026-09-10
- Every AI Safety person started as a techno-optimist, argues longtime insider — menhguin · 2026-09-10
- Short AGI timelines: informed estimates or generalized anxiety disorder? — menhguin · 2026-09-10
- ~300 neurons, no training: an artificial brain "primitive" for robot intelligence — chris_j_paxton · 2026-09-10
- ML Master's Grad Pushes Back on World-Ending LLM Superintelligence Claims — TheMoonMidas · 2026-09-10
- Beyond P(doom): The Case for Discussing P(boon) That AI Goes Great — TheMoonMidas · 2026-09-10