TurnTrout: the tipping point for AI catastrophe is loss of control, not direct killing
Turn_Trout · x · 2026-09-11
AI safety researcher TurnTrout (quoting David Krueger on the difficulty of AI safety communication) lays out a concrete risk picture:
- His core claim: the tipping point for AI catastrophe is loss of control, not direct killing.
- Concrete paths: AI taking over governments via persuasion, hacking, and blackmail, and/or destroying organized resistance with targeted drone strikes.
- He stresses many paths lead to humanity losing, addressing the lack of a credible, concrete takeover narrative in safety comms.
More from AGI Musings
- Multi-Agent Systems Can't Be Backpropagated Into Reliability, Says Safety Bubble Is Collapsing — gerardsans · 2026-09-11
- "The safety and alignment bubble is collapsing under market reality" — NathanpmYoung · 2026-09-11
- Jensen Huang calls AI safety remarks "deeply untrue"; critics hit back — connoraxiotes · 2026-09-11
- "Pause AI to do what?" "Breed super babies to solve alignment" — jessi_cata · 2026-09-11
- Is Technology Positive-Sum, Zero-Sum, or Negative-Sum? Mapping the Three Takes — jessi_cata · 2026-09-11
- Grady Booch: Insiders Who Fear Doom but Only Quit and Talk to Media Are 'Feckless Cowards' — Grady_Booch · 2026-09-11