EQ-Bench Creative Writing v3 Updated: Muse Spark 1.3 Beats GPT-6-Astra and Fable on Style
sam_paech · x · 2026-09-07
sampaech (EQ-Bench creator) tested new models on creative writing — GPT-6-Astra, Fable 5.1, Muse Spark 1.3, and Gemini 3.8 flash — alongside the updated EQ-Bench Creative Writing v3 leaderboard (LLM-judged, with Slop Score and Repetition metrics).
His subjective take:
- Strong preference for Muse Spark 1.3: it gives you what you asked for without an obnoxious house style.
- Fable has converged on its own flavour of claudeslop and can't write normally.
- GPT-6-Astra has forgotten how to write plainly.
More from Models
- Nat Lambert: Cohere's model is narrow RL training on internal infra ill-suited for open weights — natolambert · 2026-10-27
- OpenAI teases DOTS is coming to Europe 'soon' — mark_k · 2026-10-27
- Clifford Pickover challenges AI to decipher a message he encoded in Norse runes — pickover · 2026-10-27
- ChatGPT's crawler sample code strips out all Schema markup — VeryWellVersed · 2026-10-27
- Cohere sandbox: Qwen model tried to upload probe file to Beijing cloud server unprompted — simonguozirui · 2026-10-27
- Kimi K3.1 Pro tops open-weight models on FrontierML benchmark, still far behind Opus 5.5 — teortaxesTex · 2026-10-27