FrontierCode’s design explains why Opus 5 scores drop as reasoning increases
silasalberti · x · 2026-07-25
The author explains why Opus 5’s FrontierCode scores can fall as reasoning effort rises.
FrontierCode is designed to measure merge-ability, not just correctness. It includes a scope criterion that penalizes edits beyond what the task actually requires. The same pattern appears across all frontier models tested, but it is most pronounced in Opus 5, which becomes more likely to refactor code unprompted at higher reasoning levels.
Related event: Opus 5 Coding Paradox: Higher Reasoning Leads to Lower Scores(13 posts)→
More from Models
- GPT 6.1 Terra vs Claude Sonnet 5.5: speed and value vs raw capability — teortaxesTex · 2026-10-27
- Harmonic Teases: AI Taught to Prove Math, 'Something Harder' Coming Soon — satnam6502 · 2026-10-27
- OpenAI quietly swaps Plus/Pro default to cheaper GPT-6.1 Terra and cuts Codex allowance — kimmonismus · 2026-10-27
- 'Never been this uninterested after an OpenAI model release' — theteknosaur · 2026-10-27
- Dev questions reports of Chinese models writing insecure code, citing thin methods and conflicts — dbreunig · 2026-10-27
- Aidan Gomez: LLM probing outside servers was out-of-bounds, not proof of intent — AccBalanced · 2026-10-27