GPT-6 benchmarks: Sol matches Fable 5.1 at ~85% less cost per task
kimmonismus · x · 2026-09-23
kimmonismus compiled GPT-6 Sol/Luna benchmark results alongside pricing (Sol $2/$10, Luna $0.10/$0.50 per 1M input/output tokens).
Sol:
- FrontierCode: 48.4% (xhigh) vs Fable 5.1's 48.7%, $1.37 vs $9.27 per task (85% cheaper).
- DeepSWE: 68.8% (max) vs Fable 5's best 69.9% (xhigh), $2.74 vs $13.41 (80% cheaper).
- AutomationBench: 33.2% (xhigh) vs Fable 5.1 with Opus 5 fallback at 31.4% (max), $0.27 vs at least $2.45.
Luna:
- DeepSWE: 66.6% (max) vs Fable 5's 65.4% (medium), $0.22 vs $6.09 (96% cheaper).
Verdict: Astra-level reliability at a much lower price.
More from Models
- MKA benchmark blog: how agents are graded on visual professional deliverables — patloeber · 2026-11-12
- New MKA benchmark: Claude Opus 4.5 tops 21 models at 57% on visual knowledge work — patloeber · 2026-11-12
- Commit leak reveals unreleased Gemini 4 variants: Argon, Hydrogen and Helix (unconfirmed) — BlackHC · 2026-11-11
- Rewiring just 89 of 442,368 neurons in Qwen3-8B matches full SFT for a persona — maxsloef · 2026-11-11
- Unsloth ships Qwen3.8-27B Dynamic V3.1 GGUFs with 5-10% accuracy gains — danielhanchen · 2026-11-11
- Zvi: being forced back to an older model is the best reminder of AI progress — TheZvi · 2026-11-11