Open-Source 763B Model Tested on 105 Hidden Bugs

Pawel Huryn's Bug Hunt Bench planted 105 hidden bugs across two real codebases to test frontier models' debugging ability. Muse Wonder Full 1.0 led with 42/105, Opus 5.5 Max scored 41, and the open-source 763B DeepSeek V4.1 Flash fixed 34 while approaching Opus at roughly 1/150 of the cost.

2026-10-17 ~ 2026-10-17 · 3 related posts