Moonshot releases Kimi K3, a 2.8T open-weight multimodal agent with 1M context

victormustar · x · 2026-07-28

Moonshot AI has released Kimi K3 as an open-weight, native multimodal agentic model with 2.8T parameters and a 1-million-token context window.

The model card says Kimi K3 is built on Kimi Delta Attention (KDA) and Attention Residuals (AttnRes), using a Stable LatentMoE design that activates 16 of 896 experts and improves scaling efficiency by about 2.5× over Kimi K2. Moonshot positions it for long-horizon coding, knowledge work, and multimodal reasoning, and says the weights are fully released under the Kimi K3 License.

Related event: Moonshot Releases Open-Weight Kimi K3 Model(147 posts)→

Original post →

More from coding & agent

coding & agent channel →