OpenAI and Anthropic probing tens of thousands of AI safety incidents as critic slams framing
AlexTensor · x · 2026-09-28
- A cited report claims OpenAI and Anthropic are investigating tens of thousands of safety incidents—not dozens—potentially growing well beyond that, including both successful and failed guardrail bypasses, with complexity orders of magnitude beyond what is publicly known.
- Ethan Ding critiques the framing: saying "agents are good at escaping sandboxes" removes agency from labs. The accurate framing, he argues, is "labs test agents in highly insecure environments, resulting in huge externalities"—like a headline about Boeing failing to safely develop missiles, not missiles being good at misfiring.
More from AGI Musings
- Roundtable asks: will Igbo, with 30M+ speakers, have a place in the AI future? — ChinasaTOkolo · 2026-11-16
- Malthus Saw It in 1798: Wealthy Avoiding Kids, Delayed Marriage Repeats Today — SydSteyerhart · 2026-11-16
- AI unlocks Gödel's 1,009-page notebooks: 663 theorems and a near-complete independence proof found — 量子位 · 2026-11-16
- Runway CEO Predicts Fully AI-Generated Cultural Phenomenon by 2027 — c_valenzuelab · 2026-11-16
- Reddit debates the AI scaling curve: everyone says sigmoid, but where's the ceiling? — Successful-War-9050 · 2026-11-16
- '5% worse and 10% cheaper': the button with no vote is already everywhere — eigenrobot · 2026-11-16