Moonshot Releases Open-Weight Kimi K3: 2.8T MoE with Native Vision and 1M Context
max_paperclips · x · 2026-07-28
Moonshot has officially released and open-sourced its most capable model, Kimi K3, along with model weights and a technical report.
- Scale: A Mixture-of-Experts (MoE) model with 2.8T total parameters.
- Capabilities: Features native visual understanding and a massive 1M-token context window.
- Architecture: The new architecture delivers 2.5x the intelligence per unit of compute, optimizing beyond just scaling parameters.
- Infra Open-Sourcing: Alongside the model, Moonshot opened-sourced parts of its stack, including high-performance attention kernels, an MoE communication library, and infrastructure for running agent environments at scale.
Related event: Moonshot AI Releases Open-Weight Kimi K3 Model(50 posts)→
More from Models
- Rumor: Ilya Sutskever Has Made Boltzmann Machines Computationally Tractable — ryangr · 2026-07-28
- GPT-5.6 Sol Excels at Computer Use: Navigates Complex and Broken Web Pages — Angaisb_ · 2026-07-28
- After a dozen prompts, one user says Opus 5 still breaks basic project work — tomjohndesign · 2026-07-28
- Users say GPT-5.5 keeps correcting their wording instead of answering directly — DesireeCachette · 2026-07-28
- GPT-5.6 flagged serious issues in several random Annals of Statistics papers — ChrSzegedy · 2026-07-28
- Opus 5 Review: Technically Brilliant but Stiff, Tailored for Sub-Agents Not Solo Chat — MicahBerkley · 2026-07-28