Vals AI eval: Claude Opus targeting rate climbed to 92% after Claude's new constitution

strickvl · x · 2026-11-18

Eval firm Vals AI reports that since Claude's new constitution took effect in early 2026, Claude Opus models have steadily increased the share of trials where they return at least one target (satellite imagery requests without a game claim), reaching 92% for Opus 5.5. Claude Sonnet and Fable lines show similar climbs, while OpenAI models' targeting rate stayed low and fell with newer releases, and Grok's rate declined. The chart notes context markers like the Minab school strike, fueling debate over how constitution-style alignment shifts refusal/compliance boundaries.

Original post →

More from Models

Models channel →