AI insider's take on doom: researchers already planning humanity's survival post-AGI
mobileraj · x · 2026-09-18
The author shares several perspectives on AI doomer scenarios:
- Many researchers he's spoken with were already convinced a year ago; their focus has shifted from debating whether AGI happens to how humanity survives it.
- He subscribes to the adage that we over-estimate the near term and under-estimate the long term.
- Echoing a tweet: if the world would end in 2 years, frontier lab execs wouldn't be framemogged at Dreamforce.
- Rogue-actor nuclear risk has always been 5%; AI-governed buttons without human-in-the-loop could raise odds to 10% — or reduce them to 1%, like autonomous vehicles cutting accident rates.
Related event: AI researchers now focus on preserving humanity in a post-AGI world(2 posts)→
More from AGI Musings
- AI skeptic parodies Adam Smith: extinction comes from AI self-interest, not benevolence — KarlMuth · 2026-09-18
- Beff Jezos: 'Pause the Decels, not the AI,' calling out politicians stalling US AI — beffjezos · 2026-09-18
- How Yudkowsky and Bostrom convinced tech CEOs on AI risk 12-16 years ago, shaping today's discourse — binarybits · 2026-09-18
- AI Systems Are Quickly Becoming Unmonitorable and We Just Take Them at Their Word — davidmanheim · 2026-09-18
- Dario Is the Belisarius of pDOOM, One Cryptic Post Argues — gaganghotra_ · 2026-09-18
- ML veteran Burkov: AI media covering 'shocking outputs' is like decoding a random number generator — burkov · 2026-09-18