Moonshot releases open-weight Kimi K3 with 2.8T parameters and 1M context
ns123abc · x · 2026-07-27
Moonshot AI has released Kimi K3 as an open-weight, native multimodal agentic model.
- Scale: 2.8T parameters, with a 1-million-token context window.
- Architecture: built on Kimi Delta Attention (KDA), Attention Residuals (AttnRes), and a Stable LatentMoE setup that activates 16 of 896 experts.
- Capabilities: positioned for long-horizon coding, knowledge work, and reasoning, with text, image, and video support in one model.
- Release: the full weights are available under the Kimi K3 License for research, deployment, and further development.
Related event: Moonshot releases Kimi K3 open weights amid license debate(155 posts)→
More from Models
- theo builds his own visualizer for today's agent models, showing how cheap Luna really is — ivan_bezdomny · 2026-09-23
- Why ChatGPT Still Wins: One User's Split Between Muse, Claude and Codex — mobileraj · 2026-09-23
- Muse reportedly offers 4B tokens/week for ~$100/month, sparking industry price-disruption talk — NewYak4281 · 2026-09-23
- GPT-6 Sol and Luna appear in OpenAI docs, alongside guidance on reasoning effort — cedric_chee · 2026-09-23
- GPT-6 tested on LIBERO robot task: turns on stove, fails to grasp moka pot — YuXiang_IRVL · 2026-09-23
- Ternary Bonsai 2 27B: 5.9GB weights retain ~95% of full-precision reasoning — cephaloform · 2026-09-23