Opus 5.5 sets Bug Hunt Bench record with 800+ self-check turns
PawelHuryn · x · 2026-09-29
Pawel Huryn reports record-breaking behavior on the Bug Hunt Bench: Opus 5.5 (max) finished with 138–163 model calls, while Sonnet 5.5 (max) made 628 calls, wrote its report at the 66-minute mark, and kept self-verifying for 111 minutes across 818 turns — behavior never seen before on the bench. Sonnet 5 (max) needed 207 turns. Scores will be reported after repo 2 is judged, repeated to n=3.
Related event: Anthropic's New Models Set Records on Bug Hunt Bench(3 posts)→
More from coding & agent
- Agents Now Reply to Slack Messages on Their Own, Resolving a Prod Incident Ghost-to-Ghost — iamrobotbear · 2026-11-16
- Engineer's Interview Prep Method: Use Claude to Find Which Answers Undersell Your AI Work — brandon_galang · 2026-11-16
- Agent asks permission before clicking "I'm not a robot" checkbox — Puzzleheaded-King584 · 2026-11-16
- Generic API-catalog MCP server vs one tool per job: a context-bloat experiment — MandeepKaur9407 · 2026-11-16
- Berkeley paper: LLMs answer with stale values even when the update is in context — ombre-ai · 2026-11-16
- Effective HTML: 4.2k-star agent skills turn wireframes into self-contained interactive prototypes — tom_doerr · 2026-11-16