'Pre-training is definitely not dead,' dev says amid debate over GLM's frontier ambitions
himanshustwts · x · 2026-10-19
In a debate about whether pre-training has peaked, himanshustwts pushes back: "it is def not dead lol, people are making anything up." He also questions why GLM (Zhipu) should focus on closed frontier pre-training at all, arguing every lab is incentivized toward different goals. A snapshot of the ongoing community split over scaling and open-vs-closed strategy.
More from Models
- Chris Potts critiques auto-interp evaluation: precision, recall, and the case for ex ante testing — ChrisGPotts · 2026-10-19
- Mistral releases Timestral time-series foundation models, up to 209M params — petrusenko_max · 2026-10-19
- Gemini 4 Scores Just 78% on Saturated FrontierMath Tier 4, Well Behind OpenAI's Models — haider1 · 2026-10-19
- OpenRouter Data Shows US Model Token Use Flat for 8 Weeks as Chinese Providers Hit 79.2T Weekly — SumitGup · 2026-10-19
- Anthropic reportedly tests its next model under Claude Opus 5.5, users spot big quality jumps — testingcatalog · 2026-10-19
- Fish Audio open-sources 35.9B MoE TTS Drama 3, tops leaderboard while decoding faster than its 4.6B predecessor — kastnerkyle · 2026-10-19