You don't predict a tsunami by counting drownings: AI safety needs leading indicators
davidmanheim · x · 2026-09-16
davidmanheim wraps up the debate: deadline predictions yield little evidence about AI risk, which is why predictions about capabilities and misalignment indicators matter—evidence that has recently vindicated the AI safety crowd. Like tsunamis, rogue AI may kill billions without first killing thousands.
More from AGI Musings
- Uncle Bob dissects the doomer debate trick of inserting nonexistent tech into doom equations — ylecun · 2026-09-16
- Catastrophe risk modeler: Tohoku tsunami shows historical data misleads on AI risk — davidmanheim · 2026-09-16
- Agent monitoring is a precondition for safe harnesses: kill CLI, perfect sandbox, or trace surveillance — scottleibrand · 2026-09-16
- Faked alignment plus recursive self-improvement: firms can't tell real alignment from theater — birchlse · 2026-09-16
- Altman warns of open-source cyberattack wave; Byrnes backs selling frontier defense — beffjezos · 2026-09-16
- Veteran virus engineer rebuts claims that AI lets amateurs build bioweapons — aiamblichus · 2026-09-16