Moonshot AI Releases Kimi K3 with 2.8T Open Weights Using MoE
thione · x · 2026-08-03
Moonshot AI has released Kimi K3, opening the model weights. The new model features a total of 2.8T parameters and utilizes a Mixture-of-Experts (MoE) architecture, activating 104B parameters per token.
More from Models
- Ant Group Engineer's Long Post: The Four Very Different Bets of Chinese AI Labs — AcanthisittaOk1699 · 2026-08-04
- OpenAI's Upcoming 'Astra' Model to Focus on Multi-Agent Collaboration — thesaraharminta · 2026-08-04
- Testing Qwen3.8-Max: Open Models Are Catching Up with Closed Frontier — dair_ai · 2026-08-04
- Kimi K3 Estimated at 2.8T Params, Potentially Distilled from Smaller Opus — gabriberton · 2026-08-04
- Expert Replicates OpenAI Astra Math Results in 24 Hours — Gary Marcus · 2026-08-04
- Claude 3.5 Sonnet and Opus Are Remarkably Terrible at Making Slides — nathanbenaich · 2026-08-04