GPT-6.2 Astra takes #1 on LLM creative writing benchmark at 4.30; Qwen 4 Max leaps to third

sandersted · x · 2026-11-18

LechMazur updated his LLM Creative Story-Writing Benchmark (400 constrained story briefs, blind pairwise comparison with Thurstone scoring):

The benchmark (github.com/lechmazur/writing) requires incorporating 10 mandatory story elements, judged by multiple evaluator models reading matched stories in both orders.

Original post →

More from Models

Models channel →