SWE-Bench Pro V2 Hard Hits 98% on Day One, Instantly Saturated

SWE-Bench Pro V2 Hard was solved at nearly 98% by top models on its launch day, rendering it saturated and unable to differentiate frontier models. Users mocked how quickly the new benchmark was maxed out.

2026-09-23 ~ 2026-09-23 · 2 related posts

• SWE-Bench Pro V2 Hard nearly saturated at 98% on day one — 141_1337 · 2026-09-23
• SWE-Bench Pro V2 launches already saturated, sparking benchmark fatigue jokes — burny_tech · 2026-09-23