Seth Lazar on rogue AI risk: no good reason to put a tight upper bound on it
sethlazar · x · 2026-09-06
Philosopher and AI safety researcher Seth Lazar pushed back on the view that rogue AI is a serious-but-not-top-10 problem: once you concede rogue AI is a real threat, any attempt to bound its magnitude relies on a priori or highly speculative reasoning, so error bars must stay wide. The point isn't whose speculation is right — it's that downside risks can't be confidently quantified.
Related event: Timothy Lee vs Seth Lazar debate how bad rogue AI can get(20 posts)→
More from AGI Musings
- Grady Booch revives Weinberg's 1971 quip: software so buggy one woodpecker could destroy civilization — Grady_Booch · 2026-10-23
- Why Netflix keeps losing to YouTube: UGC platforms professionalize easier than pro platforms go casual — ZeroStateReflex · 2026-10-23
- AI killed the coding moat: indie devs now compete on demand and distribution — sven_ai · 2026-10-23
- DynaVelo, a neural ODE model of single-cell dynamics, published in Nature Biotechnology — anshulkundaje · 2026-10-23
- Beff Jezos: Only frontier labs out-accelerating open source can secure systems — beffjezos · 2026-10-23
- 'I don't want to live in that world': a Redditor on why AGI utopia feels meaningless — peace_venerable · 2026-10-23