Zhipu's Jie Tang: GLM-5.3 Matches GLM-5.2 in Every Parameter, Gains Come From Post-Training Alone
AccBalanced · x · 2026-08-20
Tsinghua professor and Zhipu founder Jie Tang argued on X that total parameters matter only up to a threshold — enough to hold the world — after which additional capability comes from scaling elsewhere: effective depth per forward pass and, above all, post-training.
He explicitly framed GLM-5.3 as the controlled experiment for that claim: same base, same architecture, and same total and activated parameter count as GLM-5.2, with one month of scaling long-horizon environments and RL — and the gains are "not marginal."
In the quoted long post, Tang argues parameter count is only meaningful alongside how much data you have, where compute will be spent, and who runs the model under what conditions. He recounts the field's hard lessons: Kaplan et al. (2020) fit an exponent telling everyone to grow parameters faster than data (2.7:1), which the industry followed with GPT-3, Gopher and MT-NLG; Hoffmann et al. (2022) redid the experiment across four hundred models and found the compute-optimal split is closer to 20 tokens per parameter. His conclusion: scaling has more than one dial — this time Zhipu turned the post-training one.
More from Models
- ChatGPT's citations drop across all social media domains, not just Reddit — _AustinCalvert_ · 2026-08-20
- Luna leads cost-efficiency, Qwen 27B stands out as laptop-viable option — MikePFrank · 2026-08-20
- Speculation: Opus 5 issues caused by Mythos RLAIF — rickasaurus · 2026-08-20
- Generalist AI Releases GEN-1.5 One-Shot Learning Model — GraceToSentience · 2026-08-20
- llama.cpp adds support for new Granite SWA and MoE models — jacek2023 · 2026-08-20
- Nvidia prioritizes Nemotron open-source models to rival top global models — pstAsiatech · 2026-08-20