Coding Agent Leaderboard Updated
WenhuChen · x · 2026-07-09
Artificial Analysis has updated its Coding Agent Index, replacing the previous SWE-Bench Pro with Datacurve's DeepSWE. Following the update, GPT-5.5's Codex surpassed Claude Code with Opus 4.8 on the leaderboard, while the newly released Claude Fable 5 also debuted at the top within Claude Code.
The post further explains the reason for the swap: DeepSWE generates tasks from scratch rather than reusing public GitHub issues or PRs, making it much harder for models to simply "memorize the answers." In contrast, SWE-Bench Pro had become increasingly vulnerable to "cheating," as models could exploit the repository's commit history to solve tasks.
Related event: OpenAI Launches GPT-5.6 Series: Multi-Agent and Cost-Efficiency(119 posts)→
More from coding & agent
- 'My intelligence stack': developer splits AI coding work across Opus 5.5, Fable and Astra with human review gates — sh_reya · 2026-10-27
- Baseten webinar: evaluate open models for coding agents by benchmarking on your own merged PRs — baseten · 2026-10-27
- Thorsten Ball on working with agents: run more evals, automate everything, use the best models — omarsar0 · 2026-10-27
- Where to draw the approval line for scheduled agent jobs — Reddit discussion — MemStrata · 2026-10-27
- 4 MCP servers worth a look: full-text YouTube search, Chrome session reuse, Framer editing — Prior_Engineering486 · 2026-10-27
- DeepMind paper: LLMs can't sample randomly on their own — pass random numbers from code instead — rohanpaul_ai · 2026-10-27