GPT-6.2 fixes 71/105 hard bugs in 3 runs — 20 remain unsolved by anything
PawelHuryn · x · 2026-11-19
Paweł Huryn shares anonymized bug coverage data: of 105 hard bugs that all frontier models missed at the start of 2026, GPT-6.2 (max) found and fixed 71 at least once within 3 runs. After hundreds of runs, 20 of the 105 have never been solved by anything. He calls the GPT-6.2 Sol release "so good," with Astra high/medium/low comparisons in progress.
More from Models
- Same-prompt comparison: Claude Opus 5.5 makes musical loops, outshines Astra 6.2 — dreamwieber · 2026-11-19
- Hands-on: GPT 6.2 Astra tackles 6 Blender MCP 3D builds in one-shot prompts — reddit0_r · 2026-11-19
- 'Every single candidate chose Claude': researcher notes 100% tool preference in agentic evaluations — RylanSchaeffer · 2026-11-19
- Microsoft's 'can you trust open weights?' FUD slide mocked as 7 new MAI models land — victormustar · 2026-11-19
- DevOps user slams 6.2-astra as the worst model ever: 'total gibberish' — rickasaurus · 2026-11-19
- Counter-take to "LLs have peaked": new models much better at long-horizon tasks — minhnguyen · 2026-11-19