Sonnet 5 vs Opus 4.8 in Coding Benchmarks
bisonbear2 · reddit · 2026-07-15
The author tested Sonnet 5 and Opus 4.8 using 24 real-world open-source repository tasks in Claude Code, running a head-to-head comparison across five reasoning effort levels. Patch quality was evaluated using GPT-5.4 as a pointwise judge.
Key Findings
- At high reasoning efforts, Sonnet generates patches with more checks and longer paths; the judge frequently rates them as "clear and explicit in intent."
- Opus tends to output "simple, robust, minimal diff" patches, resulting in smaller diffs in most cases.
- Cost differences are also notable: Sonnet is cheaper at low/medium tiers, but at the max tier, it becomes more expensive than Opus.
More from coding & agent
- A roundup of AI agents and MCP resources, including how to evaluate agents — _jaydeepkarale · 2026-07-21
- A full course shows how to build and deploy an AI agent with OpenAI and LangChain — _jaydeepkarale · 2026-07-21
- A beginner guide to AI agents points readers to a Stanford webinar — _jaydeepkarale · 2026-07-21
- A practical guide on how to evaluate AI agents — _jaydeepkarale · 2026-07-21
- MCP is headed toward easier scale, event-driven extensions, and workable file uploads — EricBuess · 2026-07-21
- Developers debate the missing composition model for AI agents — threepointone · 2026-07-21