GPT-6 Sol Underperforms GPT-5.6 Max on DeepSWE, 68.8% vs 72.7%
banaxi-tech · reddit · 2026-09-23
A Reddit user compared GPT-6 Sol against the previous generation on the DeepSWE benchmark: GPT-5.6 Max scored 72.7% while GPT-6 Sol managed only 68.8%, a near 4-point regression. This matches widespread user complaints that GPT-6 Sol underperforms on non-coding tasks and barely engages in extended reasoning, fueling debate over what the new generation traded away.
More from Models
- Theory: Typos Disrupt LLM Tokenization, Which May Explain Why AI Text Has a Distinct Smell — menhguin · 2026-11-11
- LMArena co-founder explains AI evaluation methodology and policy in new podcast — MattPerault · 2026-11-11
- Runway open-sources Praxis-1, turning video pretraining into real robot control — runwayml · 2026-11-11
- DeepMind launches AlphaGenome 2, spotting nearly 2x more gene-regulating mutations — GoogleDeepMind · 2026-11-11
- MazeBench: Fable 5.2 scores 15%, near-frontier at half price; Gemini 4 Carbon 11% — patience_cave · 2026-11-11
- ERNIE 5.5 Flash Preview enters LMArena Battle Mode for crowdsourced ranking — arena · 2026-11-11