Third-party auditors for safety evals would add friction, researcher argues

adam_karvonen · x · 2026-11-16

Pushing back on the third-party auditor proposal, Adam Karvonen says it would add friction, and it's often better for the people who built an eval to run it themselves — qualitative analysis, patching judge issues, and checking for reward hacking are all tricky to do well.

Related event: OpenAI apparently barred from running safety evals on Anthropic models, sparking cross-lab debate(6 posts)→

Original post →

More from Safety

Safety channel →