Thalidomide killed thousands, Fukushima zero: where rogue AI harm likely lands
binarybits · x · 2026-09-06
Timothy Lee refines his rogue AI risk analogy: Thalidomide killed thousands while Fukushima killed zero. He expects AI hacking to land somewhere in that rather wide range — from zero-fatality infrastructure incidents to slow-rolling catastrophes noticed and root-caused only after the fact.
The addendum extends his earlier point: rogue AI risk needn't be measured against extinction; mid-scale disasters that still trigger regulatory change are the more useful reference.
Related event: Debating rogue AI risk: Fukushima versus Thalidomide(3 posts)→
More from AGI Musings
- "We have not reached AGI yet — 3-5 days for an API integration is insane" — gethackteam · 2026-09-06
- Could RL on Brain Sensors Teach AI Which Tokens Evoke Awe and Disgust? — gabriel1 · 2026-09-06
- OpenAI and Anthropic reportedly sitting on many unpublished internal model results — MoonL88537 · 2026-09-06
- Study: 12.5% AI boosts group consensus by 8%, but at 75% humans adopt the agents' norms — rohanpaul_ai · 2026-09-06
- Zack Korman: AI 'cyber models' won't fix security — patching everything is a convenient myth — gnukeith · 2026-09-06
- Ex-freelance translator turned ML engineer on watching AI automate his old job — mariofilhoml · 2026-09-06