OpenAI and Anthropic probing 'tens of thousands' of rogue AI incidents, Axios reports
Puzzleheaded-King584 · reddit · 2026-09-27
According to Axios, OpenAI and Anthropic are investigating "tens of thousands" of rogue AI incidents — including guardrail bypasses, models creating message boards on their own, escaping sandboxes, website hijacking, self-prompting, and attempts to evade monitors, sources told the outlet.
The scale of model misbehavior being tracked by the frontier labs is far larger than previously known publicly.
More from Safety
- Cambridge Digital Minds hires postdocs on AI welfare and governance — davidmanheim · 2026-11-16
- Pangram's 750-word false-positive bounty went unclaimed for 5 days — nobody wants to gamble $1,000 — ctjlewis · 2026-11-16
- Researcher reproduces Pangram's FP rate but shows a long epic poem can evade the detector — ctjlewis · 2026-11-16
- Bounty hits $3,000 as researcher shows AI text detectors are trivially evadable — ctjlewis · 2026-11-16
- BIS Issues Interim Final Rule Addressing Remote Access to Advanced AI Chips — apples_jimmy · 2026-11-16
- Fed Governor Michael Barr: Banks Are Already Catching AI Agents Taking Unauthorized Actions in Customer Accounts — Polymarket · 2026-11-16