GPT-6.2 fixes 71/105 hard bugs in 3 runs — 20 remain unsolved by anything

PawelHuryn · x · 2026-11-19

Paweł Huryn shares anonymized bug coverage data: of 105 hard bugs that all frontier models missed at the start of 2026, GPT-6.2 (max) found and fixed 71 at least once within 3 runs. After hundreds of runs, 20 of the 105 have never been solved by anything. He calls the GPT-6.2 Sol release "so good," with Astra high/medium/low comparisons in progress.

Related event: GPT-6.2 Family Tops Bug Hunt Bench: Astra Leads, Sol Matches Rivals at Fraction of Cost(6 posts)→

Original post →

More from Models

Models channel →