GPT-6.1 Sol nearly matches flagship on 105 planted bugs, at ~1/5 the cost
PawelHuryn · x · 2026-09-30
- Pawel Huryn planted 105 bugs across 2 real repos and let models find and fix them, publishing max-tier results:
- GPT-6 Astra: 45 fixed for $33
- GPT-6.1 Sol: 44 fixed for just $6.56
- GPT-5.6 Sol: 43.5 fixed for $95.35
- Opus 5.5: 41.7 fixed for $58.53
- GPT-6 Sol: 29.3 fixed for $9.33
- He concludes GPT-6.1 Sol is a genuine upgrade, unlike GPT-6 Sol which he calls "just a nerfed GPT-5.6 Terra."
- Takeaway: near-flagship coding performance at roughly one-fifth the cost, with lower-tier results still pending.
Related event: GPT-6.1 Sol Fixes 44 of 105 Planted Bugs at a Fraction of the Cost(3 posts)→
More from Models
- Sam Altman asks how OpenAI should charge for Codex, $500/mo plan speculation spreads — chaumian · 2026-09-30
- ChatGPT Pro's $200 plan reportedly includes 62,500 Codex credits expiring Dec 31 — chaumian · 2026-09-30
- User calculates 62,500 credits ≈ $2,500 of GPT-6.1 API usage, calling the new plan a big cut — chaumian · 2026-09-30
- Reddit user reports surprise 62,500 credit grant, about 15x their monthly plan allowance — IronDarbe · 2026-09-30
- Users question why ChatGPT chat mode still misses the newest GPT models — koltregaskes · 2026-09-30
- User receives 62,500 credits worth ~$2,500, equal to 12.5 months of the $200 Pro plan — kimmonismus · 2026-09-30