Evaluator Independence May Become Labs' Talking Point for Regulator Shopping
BronsonSchoen · x · 2026-09-13
BronsonSchoen pushes back on claims that third-party AI eval orgs are captured by ex-lab insiders:
- METR struggled insanely hard to get even very insufficient model access, suggesting labs don't favor evaluators
- Ex-lab employees moving into evaluation is a valid career path, not a scandal
- Core warning: frontier labs' founder networks are so interconnected that cherry-picking which COIs count lets labs dismiss unwanted evaluators in the name of "rigor" or "independence"
He previously warned "evaluator independence" is becoming a talking point for "regulator shopping", noting people from GDM already posting along these lines.
More from Safety
- Dario responds to safety critics: I'd rather be mocked than see Claude used to kill — NathanpmYoung · 2026-09-14
- Vitalik Buterin: Adversarial mechanism design could be AI safety's killer app — allisondman · 2026-09-14
- Oxford thesis proposes 'Attribution-Based Control' to tackle AI privacy and alignment risks — iamtrask · 2026-09-14
- We Unite or We Fight: The Long-Term Case for International AI Governance — danfaggella · 2026-09-14
- Cohere CEO Aidan Gomez: AI Needs Evidenced Standards, Not a Big-Lab Cartel — cohere · 2026-09-14
- OpenMined's 'network sourced' AI: models as orderly clients of private repositories — iamtrask · 2026-09-14