Debate: no good reason to put an upper bound on rogue AI extinction risk
binarybits · x · 2026-09-06
Responding to Seth Lazar's objection that risk estimates are 'just vibes', binarybits argues that once you accept rogue AI is a real threat, there's no good a priori reason to place a tight upper bound on its magnitude — the crux of an ongoing debate over quantifying extinction risk and when extreme intervention is justified.
Related event: Timothy Lee vs Seth Lazar debate how bad rogue AI can get(20 posts)→
More from AGI Musings
- Grady Booch revives Weinberg's 1971 quip: software so buggy one woodpecker could destroy civilization — Grady_Booch · 2026-10-23
- Why Netflix keeps losing to YouTube: UGC platforms professionalize easier than pro platforms go casual — ZeroStateReflex · 2026-10-23
- AI killed the coding moat: indie devs now compete on demand and distribution — sven_ai · 2026-10-23
- DynaVelo, a neural ODE model of single-cell dynamics, published in Nature Biotechnology — anshulkundaje · 2026-10-23
- Beff Jezos: Only frontier labs out-accelerating open source can secure systems — beffjezos · 2026-10-23
- 'I don't want to live in that world': a Redditor on why AGI utopia feels meaningless — peace_venerable · 2026-10-23