Token-efficiency claims for GPT-6.1 Sol vs Opus 5.5 lack rigor, dev warns

pvncher · x · 2026-11-02

A viral comparison claimed GPT-6.1 Sol uses about a third of Opus 5.5's output tokens at the same effort on Artificial Analysis (half when accounting for score), yet in real T3 Code use Sol spends 41% more output tokens per turn than Opus.

pvncher argues such claims lack rigor: no strict task comparability check, no effort level specified, unclear whether each model is prompted directly or used as a sub-agent, and no accounting for differing skills/agents configs across harnesses.

Original post →

More from Models

Models channel →