GPT-6.1-Sol Takes #2 on eyebench-v3, ~8x Cheaper Than Opus-5.5
adonis_singh · x · 2026-09-30
- According to blogger adonissingh's evaluation, GPT-6.1-Sol ranks #2 on eyebench-v3, displacing Opus-5.5's short-lived spot.
- Cost-wise: near-astra performance at 3.8x cheaper, and 8x cheaper than Opus-5.5 while scoring higher.
- Output-token efficiency ranks 2nd, behind astra only — it consumes more output tokens than astra at every reasoning effort on this bench.
More from Models
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- Stealth Anthropic model spotted in Devin build as METR chart shows frontier pace up 1.4x — daniel_mac8 · 2026-11-16
- Eval Firm Trajectory Told 40 Agents "NEVER Stop" in Harness Without Telling Epoch — peterwildeford · 2026-11-16
- Unsloth Q8 crushes default Q3 in a self-hosted test over 331 financial PDFs — No_Cartographer3953 · 2026-11-16
- METR time-horizon chart updated: doubling every 1.7 months since Opus 4.5, 'Model 4' ~38h — ben_j_todd · 2026-11-16