A 7-year tour of open-model architecture explains why Kimi K3 is not just bigger
philipkiely · x · 2026-07-27
A guided tour of the last seven years of open-model architecture argues that the leap from GPT-2 to Kimi K3 is not just about scale.
- The post points readers to Ali’s worklog, which walks through the major architectural changes in open models over the last seven years.
- The framing is that Kimi K3 should be understood through the evolution of model design, not only parameter growth.
- It is presented as a reading aid for anyone who wants the historical context behind Kimi K3’s architecture.
Related event: Kimi K3 shifts attention from scale to architecture(25 posts)→
More from Models
- Leaked Terminal-Bench 4.0 chart shows GPT-6.1 Terra leading at lowest cost, unverified — Angaisb_ · 2026-10-27
- OpenAI brings GPT-6.1 Terra to the API and Codex for fast, cheap computer use — OpenAIDevs · 2026-10-27
- GPT-6.1 Terra rolls out to all Plus, Pro, Enterprise and Edu users — OpenAI · 2026-10-27
- In cyber, intention matters little: Chintala on model info leaks, and what users should do — brhydon · 2026-10-27
- Why don't more LLMs ship 10M-token context? A researcher asks about attention tradeoffs — agarwl_ · 2026-10-27
- Ortet's first health eval: 34 open-weight models, 50 tasks, generic rankings fall short — thegautamkamath · 2026-10-27