Kimi K3’s architecture is public, and the draft diagram shows KDA plus AttenRes
AccBalanced · x · 2026-07-25
A Zhihu contributor reconstructed an early architecture diagram for Kimi K3 from available information, using K2.5 as the baseline.
The post says the architecture is now public even though the weights are not, and highlights one notable detail: KDA and AttenRes appear together in K3’s design. It also notes that the diagram is an initial manual draft that will be updated once official weights are released.
More from Models
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- giffmana: the env being used in training is part of the point — giffmana · 2026-09-11
- awesome-llm-leaderboards: an open-source directory of LLM leaderboards, pricing tables, comparison tools — Last_Establishment_1 · 2026-09-11
- Anthropic claims it works to keep eval environments unidentifiable to models — MaxKannen · 2026-09-11
- Nex N2.5 Pro released on Hugging Face with 407GB of weights — jinnyjuice · 2026-09-11
- RoMa v2 image matching model unveiled in the usual black poster — ducha_aiki · 2026-09-11