Moonshot opens Kimi K3 weights and report, citing a 2.8T MoE model
eliebakouch · x · 2026-07-27
This repost quotes Moonshot’s announcement that Kimi K3 is now open, along with the model’s weights and technical report.
- K3 is described as Moonshot’s most capable model.
- It uses a 2.8T MoE architecture with native visual understanding and a 1M-token context window.
- Moonshot says the new architecture delivers 2.5× more intelligence per unit of compute.
- The company is also opening pieces of the stack behind the model, including attention kernels, an MoE communication library, and infrastructure for agent environments at scale.
Related event: Moonshot Open-Sources Kimi K3: 2.8T Params and $20M Commercial Threshold(148 posts)→
More from Models
- Reply says the next Codex release may arrive Tuesday, with a Cerebras GPT-5.6xHigh update soon — eyishazyer · 2026-07-28
- Kimi K3 weights landed hours before a live discussion on hybrid architectures and agent harnesses — hugobowne · 2026-07-28
- Commenter says Anthropic is only ahead by thin margins, not by a wide model lead — intellectronica · 2026-07-28
- Google Gemma 4 Vision token-budget demo starts trending on Hugging Face — google · 2026-07-28
- GPT 5.6 Ultra is too unstable for agent workflows, author says — tensorqt · 2026-07-28
- Firecrawl tops a SimpleQA search benchmark with 94.7%, ahead of Exa and Claude — Candid-Dog-775 · 2026-07-28