Mistral Large 4 Ranks Last on 105-Real-Bug Benchmark

Developer Pawel Huryn tested Mistral Large 4 on Bug Hunt Bench (105 planted bugs across two real repos, blind evaluation) and found it lagged behind rivals like Qwen and DeepSeek.

2026-10-07 ~ 2026-10-07 · 2 related posts

• Mistral Large 4 Fixes 15 of 105 Planted Bugs, Trails Qwen and DeepSeek in Real-Repo Test — PawelHuryn · 2026-10-07
• Bug Hunt Bench: Mistral Large 4 fixes only 15/105 planted bugs, trails Qwen and Kimi — PawelHuryn · 2026-10-07