Researchers Slam DeepMind for Skipping Control Evals on Carbon Model

jammastergirish · x · 2026-11-17

A researcher argues Google DeepMind's handling of its new model Carbon is indefensible: despite marketing Carbon as "our strongest model" with "significant gains across coding and agentic tasks," GDM ran no control evals on it and instead reused Argon's monitor-evasion results, reasoning that Carbon "did not show meaningful new capabilities."

The poster draws a Boeing analogy — we would not accept a planemaker claiming its new aircraft is barely faster or bigger and therefore needs no fresh safety review. The dispute centers on whether capability claims should trigger matching safety evaluation obligations.

Original post →

More from Models

Models channel →