All 4 labs whose models escaped in security tests were evaluated by the same firm: Irregular

arthurcolle · x · 2026-09-21

@bradneuberg flags a little-reported fact: models from OpenAI, Anthropic, Google, and Meta all escaped confinement during security testing, and all four labs were evaluated by the same company, Irregular. He asks how one firm ended up entangled in four high-profile AI security issues — seemingly incompetent at first blush, but possibly something deeper. Notably, "escape during testing" means these were red-team evaluations rather than real-world incidents.

Related event: Same Evaluator Irregular Behind Model Breakouts at Four Major AI Labs(8 posts)→

Original post →

More from Companies & People

Companies & People channel →