Opus 5 Scored 53.4% on FrontierCode at Launch, Just 48% on the 5.5 Card
mathemagic1an · x · 2026-09-23
Andrew Carr flagged that Opus 5 reported 53.4% on FrontierCode at launch but shows 48% on the same eval's 5.5 card — prompting the coinage "Benchflation": benchmark updates silently rewriting historical scores and eroding leaderboard comparability.
Related event: Opus 5's FrontierCode Score Drops from 53.4% to 48% in New Card(3 posts)→
More from Models
- Google reportedly blocking Gemini subscription use in third-party coding harnesses, flagging accounts for ToS violations — PixelCactus1 · 2026-11-08
- Alnie Seed 9B model's benchmarks questioned: mismatched numbers, FP4 speed vs FP16 scores — cneuralnetwork · 2026-11-08
- Experiment: Claude commits to answers more firmly than ChatGPT on 29 of 34 science questions — AymericRoucher · 2026-11-08
- Claude Artifacts suddenly blocks writes, users asked to grant full network egress — KeepStandardVoice · 2026-11-08
- Will Qwen4 Plus be open weights? Reddit parses Alibaba's release clues — Axiomexx · 2026-11-08
- OpenAI exec floats $50/month ChatGPT Pro tier between Plus and $100 Pro — haider1 · 2026-11-08