Kimi K3 Released: 2.8T Open-Weight Flagship with Native Vision and 1M Context
burny_tech · x · 2026-07-30
Moonshot has officially released the weights and technical report for Kimi K3. As one of the largest open-weight models to date, Kimi K3 features a 2.8T parameter MoE architecture, native visual understanding, and a 1M-token context window.
The company highlights that its new architecture delivers 2.5x the intelligence per unit of compute, rather than just scaling parameters. Alongside the model, they open-sourced high-performance attention kernels, an MoE communication library, and infrastructure for running agent environments at scale.
More from Models
- Reflection's Beam lands on Hugging Face: 501B MoE, 1M context, Apache 2.0 open weights — tomaarsen · 2026-10-16
- Reflection launches Beam 1.0, its first open-weight model built for coding, reasoning and agentic tasks — tomaarsen · 2026-10-16
- Reflection's 501B MoE Beam hits 463 tok/s on 8x GB200 with NVFP4 at day 0 — zhyncs42 · 2026-10-16
- JevBench v1.7.46 leaderboard: new d1-ultra tops 32 API systems at 76.1 composite — airesearch12 · 2026-10-16
- LMArena launches Agent Arena and Code Arena leaderboards for model comparison — arena · 2026-10-16
- Third-party tests find NVIDIA Nemotron-3.5 Bolt underperforms nano on pandas/numpy and decision-making tasks — norenEnmotalen · 2026-10-16