Mistral Large 4 scores 13.3% on sudo L7, ahead of Grok 4.7 as Claude leads at 45%
echen · x · 2026-10-13
Surge AI added Mistral Large 4 to sudo L7, its 60-task benchmark testing whether coding agents show senior-engineer judgment (navigating messy systems, spotting hidden risks, knowing when correct code shouldn't ship). Mistral Large 4 scored 13.3%, ahead of Muse Spark 1.3 (12.2%) and Grok 4.7 (10.6%). Full leaderboard: Claude Opus 5.5 and Sonnet 5.5 tied at 45%, GPT-6 Astra 32.2%, 6.1 Sol 31.7%, Claude Fable 5.1 27.2%, Qwen 3.8 Max 15.6%, GLM 5.3 15%, Kimi K3 13.9%, Hy4 Preview 11.1%, Gemini 3.8 Flash 10.6%.
More from coding & agent
- Intent Launches: Manage Swarms of Coding Agents From Your Phone — Wattenberger · 2026-10-13
- Give agents a next step: embed fix steps and doc links in API error responses — SucceededMind · 2026-10-13
- Temporal agent falls for prompt injection but scoped authority blocks the .env read before it runs — daniel_tenuo · 2026-10-13
- Simple config.toml tweak reportedly lifts 272k coding context cap to 872k — JayJeds · 2026-10-13
- EpochGo: local-first multi-agent AutoML on Ollama, $0 API costs and 100% offline — Grouchy-Excitement28 · 2026-10-13
- Ramp CTO to Discuss Internal Coding Agent Behind ~75% of Merged PRs — graceisford · 2026-10-13