Bug Hunt Bench: GPT-6 Sol (max) matches GPT-5.6 medium but trails Opus 5.5
PawelHuryn · x · 2026-09-23
New data from Bug Hunt Bench (blind-graded, 105 planted real bugs):
- GPT-6 Sol (max) ≈ GPT-5.6 Sol (medium)
- GPT-6 Sol (max) < Opus 5.5 (medium)
The board also plots score vs cost (200x spread, log axis) and time (<7x spread). Run by Pawel Huryn of The Product Compass.
Related event: Tests Show GPT-6 Sol Scales Nearly Linearly With Effort(3 posts)→
More from coding & agent
- Loom founder launches Roma 2.0, a shared to-do list that orchestrates AI agents — thetripathi58 · 2026-11-12
- Sosumi Eval: Apple Docs Access Lifts Coding Agent Pass Rates from ~33% to 94-98% — JordanMorgan10 · 2026-11-12
- CypherGuard fixes structurally wrong LLM Cypher queries, hitting 88.5% on CypherBench — JeremyCMorgan · 2026-11-12
- Building an End-to-End Hedge Fund in Python with Claude Code: A 5-Step Workflow — mdancho84 · 2026-11-12
- Jeff Dean: comfortable with engineers spending up to $10M/year on AI tools — deedydas · 2026-11-12
- Developer builds VladOS, a personal life dashboard, by just describing it to an AI agent — haltakov · 2026-11-12