A reading order for Kimi K3 traces the papers behind Moonshot’s frontier model
East-Muffin-6472 · reddit · 2026-07-29
A Reddit post lays out a reading order for understanding Kimi K3 from first principles.
- It starts with Linear Transformers Are Secretly Fast Weight Programmers as the conceptual foundation for modern linear attention.
- It then moves to Gated DeltaNet, Kimi Linear / Kimi Delta Attention (KDA), LatentMoE → Stable LatentMoE, and Attention Residuals.
- The post explains that Kimi K3 combines several research threads: efficient linear attention, better state updates, sparse expert routing, and improved residual mixing.
- It also recommends reading the Kimi model evolution in order: K1.5 → K2 → K2.5 → K3 to see how the architecture and training stack evolved over time.
Related event: Kimi K3 Open-Source Model Architecture: Dropping RoPE for KDA and LatentMoE(5 posts)→
More from Research
- Transforming quadruped robot runs on real hardware: per-pose RL policies in Isaac switched on morph — _Stocko_ · 2026-10-16
- KinoGen synthesizes robot loco-manipulation reference motions directly via kinematically grounded video generation — ChongZzZhang · 2026-10-16
- Science Robotics paper introduces F³, predictive event-based vision beyond optical flow — CSProfKGD · 2026-10-16
- VideoGen-Agent: An 8B Multimodal Agent Turns Video Generation Into a Tool-Use Loop — jiqizhixin · 2026-10-16
- Comprehension Audits: New Paper Proposes a Gate for AI-Written Code at Frontier Labs — ronbodkin · 2026-10-16
- Not Boring #215: Cammarata's Clean Networks Claim, Tesla's Flying Roadster, Tau Cut 73% — Not Boring (Packy McCormick) · 2026-10-16