METR: getting nothing would be worse than accepting Anthropic's eval terms
S_OhEigeartaigh · x · 2026-11-07
METR's SOhEigeartaigh explains why the org agreed to Anthropic's eval terms: the alternative was getting nothing, or only Anthropic's own unevidenced estimate, which he considers considerably worse than the current arrangement. The exchange follows a remark that this was Anthropic's decision, with hope that Anthropic weighs the inherent tradeoffs carefully.
Related event: METR Defends Anthropic Evaluation Deal as Better Than Self-Assessment(2 posts)→
More from Safety
- ChatGPT leak: SSE stream exposes per-chunk retrieval scores, quotes worth 100 points — lilyraynyc · 2026-11-07
- Trail of Bits: Three Lessons From Running Hundreds of AI Agents on Critical OSS — banteg · 2026-11-07
- Safety researcher: if frontier labs' warnings are true, kill switches must be ready by 2027 — S_OhEigeartaigh · 2026-11-07
- Bittensor unveils quantum-resistant wallets with post-quantum signatures and key rotation — bittingthembits · 2026-11-07
- Yudkowsky amplifies Ellsberg's 1968 warning about security clearances aimed at frontier AI insiders — ESYudkowsky · 2026-11-07
- PSA: enable two-factor authentication on your OpenReview account — CSProfKGD · 2026-11-07