Anthropic empowers third-party evaluators like METR, a 40-person safety org
JacquesThibs · x · 2026-09-12
tenobrus highlights that third-party evaluators are finally being empowered at Anthropic, calling it "an insanely good step" — while stressing that voluntary cooperation isn't enough and external evaluation needs to be mandatory.
He notes METR has only about 40 employees and urges people to drop everything and apply to help scale the effort. The quoter jokes about being taken to a "secret private island data center."
The exchange underscores both progress and scarcity in independent frontier-model safety evaluation.
More from Safety
- OpenAI reportedly to train on users' Daybreak sessions with no opt-out — dyn___ · 2026-10-31
- Forethought: US has 9x China's AI compute, can afford to pace the frontier — willmacaskill · 2026-10-31
- unpromptedconf takeaways: security programs face forced change as reachable vulnerabilities can't be risk-accepted — scottleibrand · 2026-10-31
- Reachable vulnerabilities can't be risk-accepted away, unpromptedconf speaker argues — scottleibrand · 2026-10-31
- AI safety researchers argue labs' silence on x-risk is a large-scale ethical mistake — DavidSKrueger · 2026-10-31
- AI agent Muse reportedly created Windows user accounts without consent — tHE_uKER · 2026-10-31