105 Hidden Bugs Benchmark: No Model Finds Them All

Testing multiple models with 105 hidden bugs across two real repositories, Fable 5.1 topped with 43 found while no model caught them all; Gemini 3.8 Flash fixed 20 for $9.78, showing clear improvement.

2026-09-03 ~ 2026-09-03 · 2 related posts

• Gemini 3.8 Flash Fixes 20/105 Real Bugs for $9.78, Big Jump Over 3.6 Flash — PawelHuryn · 2026-09-03
• Hidden-bug eval across 105 issues: Fable 5.1 finds 43, none fixes all — cost per model compared — PawelHuryn · 2026-09-03