Blind doc benchmark puts Kimi K3 near GPT-5.6 Sol on Word files, but far behind on slides
ell-hol1 · reddit · 2026-07-21
Kimi K3 closes in on GPT-5.6 Sol in document writing, but not in slides
A Reddit-led blind benchmark called DocBench Arena collected 3,000+ votes on 236 generated files from 400+ users. On the combined leaderboard, GPT-5.6 Sol still ranks #1 with an ELO of 1306, while Kimi K3 debuts at #6 with 1192.
- Slides: Sol is far ahead at 1373 (#1) versus K3’s 1181 (#7).
- Documents: K3 nearly matches Sol, scoring 1214 (#5) vs 1211 (#6).
- Cost: K3 averages $0.44 per finished document, compared with $0.56 for Sol.
- Speed: Sol finishes a task in about 2 minutes, while K3 takes roughly 5× longer, uses more tokens, and needs more agent steps.
The author argues Sol still holds the crown because it dominates presentations and reaches a better efficiency frontier overall. K3’s main opening is Word documents, where it is already effectively tied on quality while being cheaper, though it still lags badly on speed. The sample size for K3 is also smaller, with 186 comparisons versus 423 for Sol, so the ranking could move as more votes come in.
More from Models
- Users say GPT-5.6 Ultra feels like extra token burn with little visible gain — CtrlAltDwayne · 2026-07-21
- Early Gemini 3.6 Flash outputs look fast but weak on frontend and spatial reasoning — max_paperclips · 2026-07-21
- Anthropic removes Fable’s access deadline, but users say it was nerfed — oykun · 2026-07-21
- Kimi K3 retakes first place on DesignArena’s frontend web app benchmark — rohanpaul_ai · 2026-07-21
- Last Week in AI roundup covers Claude Sonnet 5, LongCat 2.0, and new agent benchmarks — Last Week in AI · 2026-07-21
- Rumor claims GPT-6 could arrive in August — iruletheworldmo · 2026-07-21