Writing benchmark: GPT-6.1 Sol regresses 153 Elo below GPT-6 Sol while costing more
OnlyProggingForFun · reddit · 2026-09-30
An internal writing benchmark (181 model configs, 10 script tasks, blind-scored by AI judges from three labs) finds GPT-6.1 Sol is a step back for writing:
- Its best setting (xhigh, 1976 Elo) lands 153 Elo below GPT-6 Sol's best, while costing more and slower per script ($0.13/5.8min vs $0.11/2.9min)
- Against GPT-6 Astra, xhigh ties (1976 vs 1968) at 1/6 the price ($0.13 vs $0.85) — worth switching if you're on Astra
- Effort barely matters for writing: low-to-max spans just 24 Elo; medium/high score below low; max adds nothing over xhigh for 33% more cost
- Low is Codex's default and within 25 Elo of the best setting
Verdict: stay on GPT-6 Sol for writing; if using 6.1 Sol, low is the cheap pick and xhigh the best.
Related event: GPT-6.1 Sol Launches with Astra-Level Intelligence at a Fifth of the Price(32 posts)→
More from Models
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16
- Open-weight Karpo-Decision-31B tops Decision Index at 73.9, one forward pass per answer — CodeByPoonam · 2026-11-16
- Nathan Lambert calls out Ethan Mollick for 'selectively ignoring' Kimi in model comparisons — natolambert · 2026-11-16
- Eval Firm Trajectory Told 40 Agents "NEVER Stop" in Harness Without Telling Epoch — peterwildeford · 2026-11-16
- Unsloth Q8 crushes default Q3 in a self-hosted test over 331 financial PDFs — No_Cartographer3953 · 2026-11-16