Kimi K3’s architecture is public, and the draft diagram shows KDA plus AttenRes

AccBalanced · x · 2026-07-25

A Zhihu contributor reconstructed an early architecture diagram for Kimi K3 from available information, using K2.5 as the baseline.

The post says the architecture is now public even though the weights are not, and highlights one notable detail: KDA and AttenRes appear together in K3’s design. It also notes that the diagram is an initial manual draft that will be updated once official weights are released.

Original post →

More from Models

Models channel →