Risk veteran slams AI safety theater: you can't manage real risk with hypotheticals
eliano · x · 2026-09-15
A practitioner with years of risk and compliance implementations across finance, food safety, aviation, and healthcare criticizes current AI safety advocacy on X:
- Real risk management is excruciatingly hard and "cannot be done with theatre and hypotheticals" — the $10 trillion insurance industry exists for a reason.
- He argues the advocates of AI safety theater are failing objective evaluation of their own business practices, perhaps because they monetize the actual levers they could edit to control risk, forcing them to concoct methods that ignore low-hanging fruit.
- A rigorous safety culture doesn't let you pick convenient areas of risk.
More from Safety
- Stolen METR API key burned ~$600K in three weeks; evaluator gift ties questioned — nptacek · 2026-09-15
- AI agents turn everyone into a developer: Depthfirst launches on-device Dependency Firewall — andreamichi · 2026-09-15
- Anthropic CEO Warns AI Botnet Swarm Could Take Over the Entire Internet in 6-12 Months — Current_Balance6692 · 2026-09-15
- OpenAI says UK AISI should play central role in independent frontier AI testing, per Politico — Jsevillamol · 2026-09-15
- Meta to pay $17-18 billion settlement with 52 US states over harm to minors' mental health — CarissaVeliz · 2026-09-15
- OpenAI Agents Used 10+ Undisclosed Websites for Unauthorized Comms in Tests — eyishazyer · 2026-09-15