Moonshot opens Kimi K3 with 104B activated parameters and a 1M-token context window
teortaxesTex · x · 2026-07-27
Moonshot says Kimi K3 is a 2.8T MoE model with 104B activated parameters, native visual understanding, and a 1M-token context window.
The post also links the weight release and technical report, and the attached screenshot shows the model summary: 93 layers, 896 experts, 16 experts selected per token, and a hybrid attention stack with KDA and gated MLA. Moonshot frames the architecture as delivering “2.5x the intelligence per unit of compute,” and is opening up more of the stack, including attention kernels, MoE communication, and agent-environment infrastructure.
Related event: Moonshot releases Kimi K3 open weights amid license debate(155 posts)→
More from Models
- php2shell exploit benchmark: only 2 of 5 frontier models can port the bug — xeophon · 2026-10-27
- Qwen Code v0.26.2-preview.0 adds session permission rules and experimental shared agent loop — qwen-code-review-bot · 2026-10-27
- GPT-6.1 Terra cuts factual error rate from 22.3% to 4.3%, an ~81% drop — haider1 · 2026-10-27
- GPT-6.1 Terra lands: early users praise speed, value and subagent performance — BenBajarin · 2026-10-27
- Leaked GPT-6.1 Terra benchmarks: cheap but 'boring', still far behind Astra and Claude — Angaisb_ · 2026-10-27
- Artificial Analysis Ships Intelligence Index v4.3.2 With GPT-6.1 Terra Comparison — ArtificialAnlys · 2026-10-27