Claude Opus 5 fixes 11 of 45 hidden bugs, versus 2 for Opus 4.8
PawelHuryn · x · 2026-07-25
A user reports that Claude Opus 5 fixed 11 of 45 bugs hidden in their own 28K-line VS Code extension, while Opus 4.8 fixed 2 under the exact same repo, prompt, and setup.
They say Opus 5 not only fixed more bugs, but also found the same two bugs as 4.8 plus nine harder ones, with zero false fixes. The model behaved oddly in places—ignoring “analyze this solution” and inspecting git history—but that detour led to useful insights. The poster calls Bug Hunt Bench just one test, but says Opus 5 is now their favorite model.
Related event: GPT-5.6 Beats Claude Opus 5 in Bug Hunt Benchmark(3 posts)→
More from coding & agent
- 'My intelligence stack': developer splits AI coding work across Opus 5.5, Fable and Astra with human review gates — sh_reya · 2026-10-27
- Baseten webinar: evaluate open models for coding agents by benchmarking on your own merged PRs — baseten · 2026-10-27
- Thorsten Ball on working with agents: run more evals, automate everything, use the best models — omarsar0 · 2026-10-27
- DeepMind paper: LLMs can't sample randomly on their own — pass random numbers from code instead — rohanpaul_ai · 2026-10-27
- BELL: Open-Source Stack Combines Browserbase, Eve, iMessage and Stripe Link for Personal Agents — jeff_weinstein · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27