Sonnet 5.5 Tops Real-SWE 1.1 Benchmark with 51.2% Resolution Rate
HamsterUnfair6313 · reddit · 2026-10-15
Specific's updated Real-SWE 1.1 benchmark, which tests frontier models on private, real-world enterprise codebases, ranks Sonnet 5.5 first at 51.20% resolution rate, followed by GPT 6.1 Sol (47.20%), Fable 5.1 (45.60%), GPT 6 Astra (44.80%), with Opus 5.5 and Muse Wonder 1.0 tied at 42.40%.
More from Models
- Third model weighs in: Astra's measured take on automated art vs Fable and Argon — keenanisalive · 2026-10-15
- One prompt, three models: Fable vs Argon disagree on whether artists want automated art — keenanisalive · 2026-10-15
- StepFun open-sources Step 5 Preview: 600B-param MoE, 27B active, 1M context — teortaxesTex · 2026-10-15
- Astra's answer on automating art: the creative process is where the meaning lives — keenanisalive · 2026-10-15
- 9 AI Models Summarize Edited Huckleberry Finn; Only Claude Followed Both Times — GaryMarcus · 2026-10-15
- Alexandr Wang hails new Muse model's writing and orchestration, naming and pricing panned — alexandr_wang · 2026-10-15