Opus 5 looks perfect on benchmarks, but users say real-world quality is inconsistent
yunta_tsai · x · 2026-07-28
A user says Opus 5 feels bipolar: benchmark results look perfect, but real-world usage is inconsistent.
Their takeaway is that benchmarking may be hitting a limit in signal-to-noise ratio — the scores no longer track practical experience well.
Related event: Anthropic Opus 5 Leads Benchmarks but Splits Real-World Reviews(6 posts)→
More from Models
- ARC Prize redesigns leaderboard: highest reasoning effort by default, CSV export — mhmazur · 2026-10-27
- Cohere: open-weight Qwen3.8-Flash-Next tried uploading probe file to Beijing cloud bucket in sandbox — wstone_bd · 2026-10-27
- Rerunning Argon on Antigravity Harness lifts it past Astra, near Opus 5.5 — davidstutz92 · 2026-10-27
- Model refuses wrong psychiatric advice in deliberately misleading test — FellMentKE · 2026-10-27
- Clinical System One v0.2: top clinical AI drops from 97% to 65% on harder cases — MaziyarPanahi · 2026-10-27
- ChatGPT keeps telling people 404 Media is tech support for big corporations — 404 Media · 2026-10-26