Anthropic's new model card shows METR was brought in to assess if the model is 'fooming'
dfrsrchtwts · x · 2026-09-23
dfrsrchtwts highlights his favorite part of Anthropic's new model card: how METR assessed the model. This one is a doozy — a METR team was brought in specifically to evaluate whether the model is 'fooming' (rapidly self-improving), alongside some fun evaluation tasks.
It's a rare public record of an external safety lab deeply involved in assessing a frontier model's capability trajectory, with details preserved in the model card.
Related event: Anthropic Model Card Shows METR Assessing Whether Model Is 'Fooming'(2 posts)→
More from Models
- Robot build test: GPT-6 Astra stabilizes two-board structure, Claude Fable 5.2 falls short — qinzytech · 2026-11-12
- Zvi dissects Anthropic's latest system card, disputing the autonomy threshold call — Don't Worry About the Vase (Zvi) · 2026-11-12
- Unsloth ships Qwen3.8-27B Dynamic V3.1 GGUFs with 5-10% accuracy gains — danielhanchen · 2026-11-12
- antirez backs low-bit DeepSeek 4.1 Flash over Qwen 27B dense on Apple M5 Macs — antirez · 2026-11-12
- Gemini re-renders images as text when vision is removed, dropping only 6% WSR — zacharynado · 2026-11-12
- Bare-harness coding benchmark: Fable 5.2 best overall, Gemini 4 Carbon best value — Semantic_meaning · 2026-11-12