Why people stay at AI labs despite believing in ~10% extinction risk: three rationales and a void of meaning
sebkrier · x · 2026-09-10
Jasmine Sun lays out three reasons people keep working at AI labs while believing extinction risk is around 10%: techno-determinism (someone will build ASI anyway, better I do it safely), consequentialism (utopia vs doom makes it a +EV bet), and self-interest (fun, money, friends). She notes nobody admits hyping risk for marketing—people genuinely believe it while compartmentalizing. Quoted scholar ScholarsStage adds a rarely articulated driver: the work fills a void of meaning, echoing the psychology of past revolutionaries who saw themselves as agents of history.
Related event: Why AI Researchers Stay Despite Believing Extinction Risk(3 posts)→
More from AGI Musings
- AI accusations shake literary prizes from Caine to Goncourt: who decides what's human? — TuhinChakr · 2026-10-26
- Tech discovers wargaming: applying to be Anthropic's tabletop exercise lead — round · 2026-10-26
- RSI is the culmination of the industrial revolution: a factory building a faster factory — tobias_rees · 2026-10-26
- NYT roundtable asks five experts what the rules for AI companies should actually be — ShakeelHashim · 2026-10-26
- Anti-AI content is algorithm gold and very profitable, quips commentator — annetgriffin · 2026-10-26
- Silicon Valley breakdown: five Stanford-area giants worth ~$18T — FinanceYF5 · 2026-10-26