FrontierCode v1.1: Opus 5.5 leads at 56%, mid-pack tightly packed at 43–49%
ArtificialAnlys · x · 2026-10-23
Artificial Analysis details FrontierCode v1.1, Cognition's new benchmark of 100 software engineering tasks on real open-source repos with a private test set, graded on whether a maintainer would merge the change.
Claude Code + Claude Opus 5.5 (max) leads at 56.0%, ahead of Codex + DeepSeek V4.1 Flash (52.6%), Codex + GPT-6.1 Sol (49.4%) and Codex + GPT-6 Astra (49.3%). Below the top, 15 of 24 configurations score between 43% and 49%.
More from coding & agent
- NVIDIA unveils OpenShell Reference Architecture to set boundaries for enterprise AI agents — NicoVerderosa · 2026-10-23
- Most 'unauthorized' AI agents in US bank accounts were let in by customers themselves, per Axios — nptacek · 2026-10-23
- Personal AI agents become a capital-intensive race as cloud execution environments reshape cost structures — sujingshen · 2026-10-23
- LLMs make code so cheap that recursive rewrites could make verified software tractable — jd_pressman · 2026-10-23
- Hugging Face hands OpenEnv RL environments project to Linux Foundation for neutral governance — lmoroney · 2026-10-23
- Theo writes the definitive explainer on what an AI coding "harness" actually is — pvncher · 2026-10-23