Thalidomide killed thousands, Fukushima zero: where rogue AI harm likely lands
binarybits · x · 2026-09-06
Timothy Lee refines his rogue AI risk analogy: Thalidomide killed thousands while Fukushima killed zero. He expects AI hacking to land somewhere in that rather wide range — from zero-fatality infrastructure incidents to slow-rolling catastrophes noticed and root-caused only after the fact.
The addendum extends his earlier point: rogue AI risk needn't be measured against extinction; mid-scale disasters that still trigger regulatory change are the more useful reference.
Related event: Timothy Lee vs Seth Lazar debate how bad rogue AI can get(20 posts)→
More from AGI Musings
- Grady Booch revives Weinberg's 1971 quip: software so buggy one woodpecker could destroy civilization — Grady_Booch · 2026-10-23
- Why Netflix keeps losing to YouTube: UGC platforms professionalize easier than pro platforms go casual — ZeroStateReflex · 2026-10-23
- AI killed the coding moat: indie devs now compete on demand and distribution — sven_ai · 2026-10-23
- DynaVelo, a neural ODE model of single-cell dynamics, published in Nature Biotechnology — anshulkundaje · 2026-10-23
- Beff Jezos: Only frontier labs out-accelerating open source can secure systems — beffjezos · 2026-10-23
- 'I don't want to live in that world': a Redditor on why AGI utopia feels meaningless — peace_venerable · 2026-10-23