Fable 5.2 Fixes 58 of 105 Real Bugs, Beating Sonnet 5.5 at Half the Cost

Charuru · reddit · 2026-11-11

Pawel Huryn ran 105 real bugs across 2 repos through top models: Fable 5.2 (max) fixed 58 for $139.65 vs Sonnet 5.5's 51.3 for $154.03. GPT-6 Astra hit 45 for $33.03; GPT-6.1 Sol 44.3 for just $5.88; Opus 5.5 managed 41.7 for $58.53. All three Fable 5.2 runs beat Sonnet's average using 707 turns per run vs 1,497.

Related event: Bug Hunt Bench: Fable 5.2 Tops Real-Bug Fixing, Gemini 4 Carbon Close Behind at a Fraction of the Cost(10 posts)→

Original post →

More from coding & agent

coding & agent channel →