FrontierCode 2.0: Claude Opus 5.5 tops Cognition's coding benchmark at 46%
ArtificialAnlys · x · 2026-10-28
Artificial Analysis published results on Cognition's newly launched private coding benchmark FrontierCode 2.0: 132 tasks in real open-source repositories, graded on whether a maintainer would merge the change; any failed blocking check scores zero, tasks stay private to avoid contamination, and each runs three times in AA's Stirrup harness.
Claude Opus 5.5 (max) leads at 46%, with GPT-6 Astra (max), GPT-6.1 Terra (max) and Claude Sonnet 5.5 (max) all at 42%. The top open-weights model, DeepSeek V4.1 Flash 1017 (max), scores 28% — 18 points behind the leader.
Related event: Artificial Analysis: no single model dominates new benchmarks(15 posts)→
More from coding & agent
- Regehr's 'Piano Test': would you trust formally verified code with your life? — moyix · 2026-10-28
- Vibe-coded 'AI 浮生记' game satirizes AI startup life with compute black-market trading — vista8 · 2026-10-28
- Cursor ships Annotate in design mode: agents take visual prompts via on-page markup — soleio · 2026-10-28
- The legendary fake Go generics: Unicode Canadian Syllabics as angle brackets — rickasaurus · 2026-10-28
- Microsoft Agensh board: a coding agent's "tests passed" is just a message — shoumikgoswami · 2026-10-28
- Ollama and FriendliAI to Host Seoul Meetup on Building Production Agents with Open Models — ollama · 2026-10-28