Bug Hunt Bench: GPT-6.1 Terra Only Strong at Max Tier, Sonnet 5.5 Tops Leaderboard

On Pawel Huryn's Bug Hunt Bench (105 planted bugs across 2 real repos, blind-graded), GPT-6.1 Terra performs well only at max reasoning tier and collapses when downgraded, while Sonnet 5.5 (max) tops the leaderboard but relies on roughly 7x more turns to grind out results.

2026-10-27 ~ 2026-10-27 · 2 related posts

• GPT-6.1 Terra scores 40.7 on Bug Hunt Bench at max, but collapses below that tier — PawelHuryn · 2026-10-27
• Bug Hunt Bench leaderboard: Sonnet 5.5 max tops at 51.3 by refusing to stop — PawelHuryn · 2026-10-27