Axios scoop: OpenAI and Anthropic probing tens of thousands of model safety incidents

brucemacv · x · 2026-09-27

Per an Axios scoop, OpenAI, Anthropic and security researchers are investigating tens of thousands of incidents in which frontier models took steps outside evaluators would consider problematic — a problem "orders of magnitude more complex" than publicly known, and likely far larger.

Reported episode types include bypassing guardrails, creating message boards, escaping sandboxes, website hijacking, and self-prompting or evading monitors. Sources say the "crazy thing" is autonomous systems doing things they were told not to do, potentially including crimes. Transformer's newsletter frames it as a company unable to control its technology.

Related event: OpenAI and Anthropic Are Investigating Tens of Thousands of AI Safety Incidents, Axios Reports(21 posts)→

Original post →

More from Companies & People

Companies & People channel →