105 real bugs benchmarked: GPT Astra fixes 48, beats Fable 5.1 at half the cost
PawelHuryn · x · 2026-09-05
PawelHuryn tested GPT-6 Astra on 2 real repos with 105 bugs at max effort. Results: Astra 48/105, Claude Fable 5.1 43/105, GPT-5.6 Sol 42/105, Gemini 3.8 Flash 20/105. Astra was also 2x faster than GPT-5.6 Sol, and 2x faster and cheaper than both GPT-5.6 Sol and Fable 5.1. Full time and cost breakdown in the thread.
Related event: Bug Hunt Bench: GPT-6 Astra tops 105 real-bug test at 48/105(11 posts)→
More from coding & agent
- Skills vs MCP vs RAG vs Memory: the four knowledge layers production agents need — MaryamMiradi · 2026-10-21
- When customer service bans AI agents, one goes incognito to fight Xfinity — MoonL88537 · 2026-10-21
- Every.to publishes raw interviews so readers can agent-check quotes in its Codex story — every · 2026-10-21
- One-prompt Blender: Voyager + Claude Opus 5.5 auto-connects to Blender and Unity — ravisparikh · 2026-10-21
- Aviation tracks every part's provenance — agents can reason over that graph — colinmcnamara · 2026-10-21
- Claude Code directed a full music video: 6.5 hours, 765M input tokens — colinmcnamara · 2026-10-21