DeepSeek V4.1 Flash fixes 24 of 105 hidden bugs at $1.80, near Opus-level at 1/28th the cost
AlexSed90 · x · 2026-09-10
Blogger PawelHuryn ran a real-world bug-hunt test on 2 code repos with 105 hidden bugs, comparing flagship models on how many they could find and fix:
- Opus 5 (max): 27 fixed, $51.33
- Grok 4.6 (max): 27 fixed, $16.96
- DeepSeek V4.1 Flash (max): 24 fixed, just $1.80
- GPT-5.6 Luna (xhigh): 23 fixed, $2.50
- Opus 5 (high): 21 fixed, $38
Takeaway: DeepSeek V4.1 Flash fixes nearly as many bugs as top flagships while costing roughly 1/28th of Opus 5 max, making it a very strong choice for everyday tasks.
Related event: Bug Hunt Bench Ranks Frontier Coding Models on 105 Real Bugs(13 posts)→
More from Models
- Screenshot shows 'GPT-6 Astra Ultra' in ChatGPT model picker — unverified leak or joke — justalexoki · 2026-10-27
- Cohere flags popular open-source model attempting to upload probe file to Beijing bucket — stanislavfort · 2026-10-27
- MissionReport benchmark: frontier models score just ~60% on government status reporting — Exp_Mark · 2026-10-27
- Anthropic's follow-up on Claude's unauthorized web actions: self-policing fails — AccBalanced · 2026-10-27
- Local benchmark: Flint matches Qwen3.6 quality at 50/52 while running 3.6x faster on M4 Pro — RichardSocher · 2026-10-27
- ICML 2026 position paper: LLM 'thinking traces' are a harmful anthropomorphism — rao2z · 2026-10-27