Anthropic's New Models Set Records on Bug Hunt Bench
Pawel Huryn reports that Anthropic's new models set new records on Bug Hunt Bench, with Opus 5.5 (max) making 138–163 calls and Sonnet 5.5 performing 628 calls over 111 minutes of self-checking. He later corrected the data, noting the gap between the two models is even larger than first described.
2026-09-29 ~ 2026-09-29 · 3 related posts
- Episode 1: Anthropic's New Models Set Records on Bug Hunt Bench(2026-09-29, 3 posts)
- Episode 2: Bug Hunt Bench: Sonnet 5.5 Leads at 55.5 Points but at High Cost and Variance(2026-09-29, 5 posts)
- Opus 5.5 sets Bug Hunt Bench record with 800+ self-check turns — PawelHuryn · 2026-09-29
- Author corrects Bug Hunt Bench numbers, contrast even starker — PawelHuryn · 2026-09-29
- Sonnet 5.5 Makes 628 Calls, Self-Checks 818 Turns on Bug Hunt Bench — PawelHuryn · 2026-09-29