Opus 5.5 does worse and costs more at Max thinking — Medium beats Max on hard benchmark
davidyin44 · x · 2026-09-26
morganlinton spent four days benchmarking Opus 5.5 on his own VulcanBench Frontier v4 (hard tasks built to stump frontier models) and found counterintuitive results:
- Opus 5.5 performed better at Medium and High thinking than at Extra High and Max
- Cost spikes at Max, but accuracy doesn't improve — extra thinking is a net loss here
- Fable 5.1 was most accurate overall, but only at Max — and surprisingly cheaper there than at Extra High, which ties Opus 5.5
The author cautions these are deliberately hard tasks, not representative of everyday workloads.
More from Models
- Running DeepSeek 4.1 locally on an $800 rig with a used RTX 3090 at 2-3 tok/s — LankyGuitar6528 · 2026-11-11
- Google open-sources Harness², an agent that rewrites its own setup per task — Arindam_1729 · 2026-11-11
- Dev dumps Codex desktop app over quality issues, falls back to codex-cli — tekbog · 2026-11-11
- Why do old models get dumber before launches? Lab party, says joking X post — glcst · 2026-11-11
- Grok Bot now detects hidden prompt injections, warns users and refuses to follow them — XFreeze · 2026-11-11
- Shanghai Institute Open-Sources Nex-N2.6, a 321B Multimodal Agentic Model — victormustar · 2026-11-11