GPT-6.2 Sol drops 3 points on Coding Agent Index despite release hype
ArtificialAnlys · x · 2026-11-18
Artificial Analysis notes that on the Coding Agent Index (Codex harness, max effort), GPT-6.2 Astra is flat with GPT-6 Astra while GPT-6.2 Sol loses 3 points vs GPT-6.1 Sol — driven by a 14-point drop on SWE-Atlas-QnA-AA, with the new model more likely to omit key facts. Several effort tiers still sit on the Cost-per-Task Pareto frontier; Claude Code variants still top the index.
Related event: GPT-6.2 Cuts Price 20% but Coding Stalls in Third-Party Benchmarks(4 posts)→
More from coding & agent
- tldraw office hands-on: sketch specs on a whiteboard together with agents — max__drake · 2026-11-18
- OpenAI says start daily coding with GPT-6.2 Sol: near-flagship scores at ~1/5 the cost — OpenAIDevs · 2026-11-18
- GPT-6.2 Astra tops Agents' Last Exam: +5.2 points at under one-third the per-task cost — OpenAIDevs · 2026-11-18
- LangSmith adds three controls for sensitive trace data access — LangChain · 2026-11-18
- Tejas Kumar's Daiku agent harness filled out his Shark Tank application—and got him on the show — TejasKumar_ · 2026-11-18
- Anthropic launches Linked billing beta: pay for Claude API in third-party apps without sharing keys — ClaudeDevs · 2026-11-18