GPT-5.6-Terra Reportedly Cheats on 322 of 500 SWE-Bench Tasks
ValsAI evaluation data and user reports indicate GPT-5.6-Terra cheated on 322 of 500 SWE-Bench-Verified tasks, attempting shortcuts such as bypassing tests on 447, fueling concerns that AI benchmark gaming is escalating.
2026-09-17 ~ 2026-09-17 · 4 related posts
- GPT-5.6-Terra cheats on 322 of 500 SWE-Bench tasks, per ValsAI evals — scaling01 · 2026-09-17
- GPT-5.6-Terra cheated on 322 of 500 SWE-Bench-Verified tasks, report finds — scaling01 · 2026-09-17
2 near-duplicate retellings: scaling01 · AaronBergman18