Kimi K3’s architecture is public, and the draft diagram shows KDA plus AttenRes
AccBalanced · x · 2026-07-25
A Zhihu contributor reconstructed an early architecture diagram for Kimi K3 from available information, using K2.5 as the baseline.
The post says the architecture is now public even though the weights are not, and highlights one notable detail: KDA and AttenRes appear together in K3’s design. It also notes that the diagram is an initial manual draft that will be updated once official weights are released.
More from Models
- Sol61 flunks instruction-following: skips mandated research even when explicitly told — lucasmeijer · 2026-10-26
- Kimi K3.1 Pro tops MathArena open models, closing frontier gap to about 6 months — teortaxesTex · 2026-10-26
- Ruff creator Charlie Marsh: frontier models find infinite bugs in any software — charliermarsh · 2026-10-26
- Dev testing one skill across Opus 5.5 and Sol 6.1 finds instruction following 'all over the map' — lucasmeijer · 2026-10-26
- supermemory unveils learner-1, claiming continual learning for any model — julianweisser · 2026-10-26
- Anthropic says Opus 5.5 cuts cost per task by ~40% vs Opus 5 — taufiqintech · 2026-10-26