GPT-6 Sol Gains 2 Points in Coding Agent Index at Half the Cost
ArtificialAnlys · x · 2026-09-23
Follow-up from Artificial Analysis: in OpenAI's Codex harness, GPT-6 Sol (max) scores 57 in the Coding Agent Index (+2 over GPT-5.6) at roughly half the cost per task, while Luna (max) regresses 2 points. A sub-finding of its full GPT-6 evaluation.
More from Models
- MKA benchmark blog: how agents are graded on visual professional deliverables — patloeber · 2026-11-12
- New MKA benchmark: Claude Opus 4.5 tops 21 models at 57% on visual knowledge work — patloeber · 2026-11-12
- Google's Physical-Engineering's Last Exam: all 14 frontier models score below 50% — dl_weekly · 2026-11-12
- Commit leak reveals unreleased Gemini 4 variants: Argon, Hydrogen and Helix (unconfirmed) — BlackHC · 2026-11-11
- Rewiring just 89 of 442,368 neurons in Qwen3-8B matches full SFT for a persona — maxsloef · 2026-11-11
- Unsloth ships Qwen3.8-27B Dynamic V3.1 GGUFs with 5-10% accuracy gains — danielhanchen · 2026-11-11