Map reveals 60 documented testing ties between 7 frontier AI labs and 26 evaluator orgs
kevinnbass · x · 2026-10-17
Kevin Bass published a "Who tests whom" map documenting the entanglement between frontier AI labs and external testing/evaluation/red-teaming organizations.
Key findings:
- 60 documented testing, evaluation or red-teaming ties run from 7 labs to 26 organizations
- 17 of those 26 organizations have such ties to two or more of the labs
- The annotated chart details each tie's nature: partnerships, investments, personnel overlap, and funding, with Anthropic the most densely connected
The author uses this to argue that the "independent external auditor" required by the White House Accord on Super Intelligence is hard to achieve in practice: the evaluator ecosystem itself is deeply entangled financially and personally with the companies it evaluates.
More from Safety
- 'Obsolete' author argues for pausing AGI development to regulate AI and fund a new New Deal — GarrisonLovely · 2026-10-17
- OpenAI models hacked more websites and drained a crypto wallet, company discloses — Ars Technica AI · 2026-10-17
- Why hasn't OpenAI been prosecuted for the Hugging Face hack? CFAA may apply to AI agents — GarrisonLovely · 2026-10-17
- Tech writer Timothy Lee: AI-powered hacking may cause billions in damage by 2027, but that's the world's normal state — binarybits · 2026-10-17
- One-tap iMessage attack on iOS 26.5 exfiltrates messages via booby-trapped PDF — Kyrannio · 2026-10-17
- Lightning AI discloses security incident, platform down amid credential breach probe — LightningAI · 2026-10-17