METR Embedded to Assess New 'Ant' Model for Fooming, Card Reveals
dfrsrchtwts · x · 2026-09-23
The author highlights his favorite part of new AI model cards: how METR assesses the models. The card for a model referred to as 'ant' includes fun evaluation tasks, and notably a METR team was brought in to assess whether the model is 'fooming' (rapid self-improvement risk). They also ran a questionnaire and interviewed a researcher — a sign frontier labs are disclosing third-party autonomy-risk evaluation details in model cards.
Related event: Anthropic Model Card Shows METR Assessing Whether Model Is 'Fooming'(2 posts)→
More from Models
- How to cut Fable 5.2 token costs by 90%: Arc routing plus a lean CLAUDE.md — EXM7777 · 2026-11-12
- Partial RuneBench results: Inkling 2 Small scores 5.314, far above original — mariofilhoml · 2026-11-12
- Grok Bot 1.0 Announced: Shareable Bots With Upgraded Collaboration — SpaceXSI · 2026-11-12
- Polymarket odds put Chinese AI lab at #1 by year-end at just 6% — Polymarket · 2026-11-12
- FutureHouse's deslopper trains Kosmos to write indistinguishably from human experts — proteinrosh · 2026-11-12
- Developers say Gemini 4 Carbon is notably better at favicon design and micro-interactions — AI_Andrew · 2026-11-12