Internal benchmark: GLM-5.3 Flash writes scripts at 1/429th the price, 1.7 points behind
OnlyProggingForFun · reddit · 2026-09-27
The author ran an internal creative-writing benchmark: models wrote full YouTube scripts (10 real tasks, 5 scripts each) scored by three AI judges against their own edited references. GLM-5.3 Flash cost $0.0074 per script and scored 88.2, vs Claude Fable 5.1 at max effort scoring 89.7 for $3.15 — 429x the price for 1.7 points. Many pricier setups scored worse. The author suggests blind-testing with hidden model names and counting publishable scripts and editing time.
Related event: Homegrown writing benchmark: GLM-5.3 Flash near top quality at tiny cost(2 posts)→
More from Models
- Fable 5.2 hands-on: great at well-defined hard problems, best since GPT 6 Astra — rachittshah · 2026-11-11
- The next AI vendor lock-in won't be the model API, it'll be the harness — Arindam_1729 · 2026-11-11
- Leaked: OpenAI's GPT-6.2 (codename betelgeuse) reportedly weighs in at ~15T tokens, drops Thursday — iruletheworldmo · 2026-11-11
- Running DeepSeek 4.1 locally on an $800 rig with a used RTX 3090 at 2-3 tok/s — LankyGuitar6528 · 2026-11-11
- Google open-sources Harness², an agent that rewrites its own setup per task — Arindam_1729 · 2026-11-11
- Dev dumps Codex desktop app over quality issues, falls back to codex-cli — tekbog · 2026-11-11