Mistral: le Chonk beats GLM 5.3 and Kimi K3 in 64% of blind human code preference tests
b_roziere · x · 2026-10-30
Mistral's Hugo adds data to the le Chonk (Mistral Large 4) release: in Surge Code's blind human preference evals for code, it beats GLM 5.3 and Kimi K3 in 64% of cases and DeepSeek V4.1 Flash in 56% — though only 22% against Claude Opus 5.5.
He says this confirms the signal from FrontierCode 2.0, which evaluates real-world engineering work including whether a maintainer would merge a change. This is a follow-up to the same-day release post.
Related event: Mistral Open-Sources 1T-Parameter MoE Model Le Chonk(37 posts)→
More from Models
- Dream raises $17M seed from a16z to build spatial-reasoning AI for AEC — a16z · 2026-10-30
- Investor bets speech-to-speech will be massive, praises Phonic's model — graceisford · 2026-10-30
- User Praises OpenAI for Doubling Pro Usage and Including API in Pro Sub — Angaisb_ · 2026-10-30
- OpenAI doubles usage limits for Pro tiers and Business Premium, effective immediately — Polymarket · 2026-10-30
- Gemini 4 Argon tops 4 robotics tasks on RLE-Bench, ranks #2 behind GPT-6 Astra — daibond_alpha · 2026-10-30
- Rumor: GPT-6.5 Bel comes from a 10-trillion-parameter pretraining run — VraserX · 2026-10-30