Katja Grace: 10-20% AI extinction odds this century — but she fears the non-extinction world more
NathanpmYoung · x · 2026-11-22
Nathan Young resurfaces AI-risk researcher Katja Grace's essay "The other side of the tidal wave."
- She puts maybe 10-20% odds on AI causing human extinction in the coming decades, yet feels more distressed than that number implies
- Because even in the no-extinction case, she can't imagine life not going off the rails: writing, explaining things, friendships where you're of use, pride in skills, thinking, learning, figuring things out — many things she loves seem likely to end or be badly disrupted by superhuman AI
- She doesn't trust the replacements to be actually good, good for us, or reversible
The closing line is widely quoted: "Even if we don't die, it still feels like everything is coming to an end."
Related event: Katja Grace's Essay Resurfaces: Fear the Non-Catastrophic AI Future Too(2 posts)→
More from AGI Musings
- TIME now sells ads hidden from humans and shown only to AI agents — Specialist_Lab_4226 · 2026-11-22
- RLVR trains models to maximize task reward — long-term code maintainability is on you — bendee983 · 2026-11-22
- Kenneth Stanley: AI's Riemann proof vindicates 'Why Greatness Cannot Be Planned' — kenneth0stanley · 2026-11-22
- Kasparov on AI math: brute force beat humans at chess without thinking like us — stevenstrogatz · 2026-11-22
- Fields medallist Tim Gowers speaks at London March Against AI Extinction — birchlse · 2026-11-22
- Guardian investigates the uncharted trauma of breaking up with AI companions — TobyWalsh · 2026-11-22