105 real bugs blind benchmark: MiMo-V2.6-Pro scores 22.7 for $0.86, a strong Pareto frontier
Greg_GL_87 · x · 2026-09-22
A blind judge benchmark across 2 real repos and 105 real bugs (find-and-fix task):
- Muse Spark 1.3 (max): 32.2 for $18.11
- GPT-5.6 Luna (max): 31.5 for $2.82
- Grok 4.7 (xhigh): 28.8 for $22.89
- MiMo-V2.6-Pro (default): 22.7 for $0.86
- DeepSeek V4.1 Flash (max): 21.7 for $0.78
- Gemini 3.8 Flash (high): 18 for $11.03
Takeaway: MiMo-V2.6-Pro and DeepSeek V4.1 Flash form a strong Pareto frontier — an order of magnitude cheaper with scores close to the flagships. Note MiMo ran on default effort while others ran max.
Related event: Bug Hunt Bench: GPT-6 Astra Tops 105-Bug Fixing Test, MiMo Stuns on Value(18 posts)→
More from Models
- YC-backed Monte launches post-training platform to build proprietary models from your agents' real work — ycombinator · 2026-11-12
- Leak Claims OpenAI Will Launch Entire GPT-6.2 Family Tomorrow to Counter Opus 5.5 and Fable 5.2 — heypearlai · 2026-11-12
- ARC-AGI-3 leaderboard: models score 90%+ but at $10K+ per task — haider1 · 2026-11-12
- LMArena Launches Agent Arena for Head-to-Head Agent Evaluation — arena · 2026-11-12
- LLMs lack hyperlocal municipal data, explains disputed Texas power outage debate — csuwildcat · 2026-11-12
- Claude API's per-message effort lets you switch reasoning levels without breaking prompt cache — lyraxana · 2026-11-12