Kimi K3, GPT-5.6 Sol and Fable 5 were tested on six newsroom jobs

local___host · reddit · 2026-07-24

A newsroom experiment compared Claude Fable 5, GPT-5.6 Sol, and Kimi K3 on six data-heavy reporting tasks with identical source packs and no web access.

Main findings

• Fable 5 acted like the strongest editor: it recovered reporting details and context others missed, but five of six stories exceeded the 600-word limit.
• GPT-5.6 Sol was the most compliant: it hit length and format requirements perfectly, but the prose was flatter and more list-like.
• Kimi K3 looked like an exhaustive reporter with a huge thinking budget: dense and well structured, but four of six stories also ran over the word ceiling.

Operational surprise

• At a 16,000-token completion cap, three of six runs spent the entire budget on reasoning before finishing.
• A Tour de France fixture even reasoned past a doubled cap before succeeding under bounded reasoning.

Charts and grounding

• The authors opened up the chart vocabulary and found it meaningfully changed editorial choices.
• Across the three frontier writers, 218 numeric chart values were traced back to source material with zero fabricated numbers in the audited numeric values.
• One caveat: an external audit found a wrong temperature baseline in a string label for one Sol chart, so the zero-fabrication claim applies only to numeric chart values.

Original post →

More from Models

• OpenAI ships GPT-6.1 Terra; Brockman says its computer use now beats his own speed — gdb · 2026-10-27
• Kimi K3.1 Pro regresses on Debate Benchmark while DeepSeek 1017 gains at lower cost — teortaxesTex · 2026-10-27
• 4 Hours of LLM Startup Research Produced a Convincing but Nonsense Product Thesis — annetgriffin · 2026-10-27
• Dev argues Claude burns far more tokens than GPT models for the same coding work — haider1 · 2026-10-27
• MiniMax matches Claude Opus 4.5 in non-benchmaxxed evals, users report — teortaxesTex · 2026-10-27
• Real-world math: GPT-6.1 Terra's half price is offset by 2-3x token usage, costing more than Sol — lordpuddingcup · 2026-10-27

Models channel →