Independent eval of Opus 5.5 vs GPT-6 across 100 coding environments diverges from AAII
sandersted · x · 2026-09-24
A team tested Opus 5.5, GPT-6-Sol, and GPT-6-Luna across 100 open-ended coding/engineering environments, with results diverging significantly from AAII. GPT-6-Astra remains comfortably frontier. Opus 5.5 ranks #2-#7 on coding categories and is second-best at one-shot coding — their best correlate of fluid intelligence. Its lower pricing is welcomed as Anthropic's first reasonably priced model, but it underperformed in their custom harness, a pattern since Fable 5.1 where one-shot intelligence outpaces agentic results.
Related event: GPT-6 Sol vs Claude Opus 5.5: Third-Party Benchmarks Roll In(3 posts)→
More from Models
- MiniMax H3 hits 100 days open-source: 1,472 derivative models, 148M+ downloads — linoy_tsaban · 2026-11-11
- Meituan's LongCat-2.5 trends on Hugging Face as MoE multimodal model — meituan-longcat · 2026-11-11
- Fable 5.2 hands-on: great at well-defined hard problems, best since GPT 6 Astra — rachittshah · 2026-11-11
- The next AI vendor lock-in won't be the model API, it'll be the harness — Arindam_1729 · 2026-11-11
- Leaked: OpenAI's GPT-6.2 (codename betelgeuse) reportedly weighs in at ~15T tokens, drops Thursday — iruletheworldmo · 2026-11-11
- Running DeepSeek 4.1 locally on an $800 rig with a used RTX 3090 at 2-3 tok/s — LankyGuitar6528 · 2026-11-11