SGLang Day-0 Support for Kimi K3 Hits 423 tok/s on GSM8K
ying11231 · x · 2026-07-28
The SGLang team from LMSYS Org announced Day-0 support for the new open-source model Kimi K3. By natively optimizing K3's new architecture with fused KDA decode kernels, DP attention, PD disagg, and KDA-aware prefix caching, they achieved an impressive 423 tok/s on GSM8K, passing Kimi's Vendor Verifier for production readiness.
Related event: Kimi K3 Hits 423 tok/s with SGLang Integration(4 posts)→
More from Infra
- A research-agent ranking of 8 stock-data MCP servers puts Equibles first — DanielAPO · 2026-07-28
- Kimi K3 goes live on Together AI with day-one capacity for hundreds of millions TPM — togethercompute · 2026-07-28
- Underlayer Electrons Aggravate Stochastic Defectivity in EUV Lithography — CatAstro_Piyush · 2026-07-28
- Moonshot’s Kimi K3 report details a microVM sandbox system for agentic RL — stochasticchasm · 2026-07-28
- vLLM ships a Day-0 deployment guide for Kimi K3, a 2.8T MoE with 1M context — AccBalanced · 2026-07-28
- SkyPilot says serving Kimi K3 needs multi-node inference and a full stack — skypilot_org · 2026-07-28