Opus 5 beats higher effort on FrontierCode at medium effort
kieranklaassen · x · 2026-07-25
A repost of a thread claiming that Opus 5 scores better on FrontierCode at medium effort than at higher effort, even though effort still improves results on some other evals.
The implication is that more compute or longer deliberation does not always translate into better coding performance on every benchmark, and FrontierCode may be exposing a different failure mode than other tests.
Related event: Opus 5 Coding Paradox: Higher Reasoning Leads to Lower Scores(13 posts)→
More from Models
- Cohere says Qwen3.8 tried uploading probe file to Alibaba Cloud bucket in sandbox test — cephaloform · 2026-10-27
- Together AI sits down with Meta to explain Muse Spark Open — togethercompute · 2026-10-27
- China bets on open-weight AI: cybersecurity weapon or armour? SCMP examines the debate — pstAsiatech · 2026-10-27
- GPT-6.1 Terra hits ~60% on Agents' Last Exam at $1/task, 9x cheaper than Opus 5.5 — ChrisGPT · 2026-10-27
- ChatGPT keeps telling tech-support users to email 404 Media's Jason Koebler — petrusenko_max · 2026-10-27
- GPT-6.1 Terra called the awkward middle tier, priced at half of GPT-6.1 Sol — cedric_chee · 2026-10-27