Kimi K3 launches on SGLang with 423 tok/s and 11 cloud partners
ying11231 · x · 2026-07-28
- Kimi K3 is now live on SGLang with a reported 423 tok/s day-0 speed on GSM8K.
- The post highlights that the demo video was generated by Kimi K3 itself, running on the same serving stack being announced.
- Engineering details include a 2.8T MoE model, a novel KDA architecture, and deep serving optimizations such as fused decode kernels, DP attention, DSpark, PD disaggregation, and KDA-aware prefix caching.
- The ecosystem launch included 11 cloud partners serving the model from day one, framed as a sign of a mature open-source stack where model, infra, and cloud providers ship together.
Related event: SGLang Day-0 Support for Kimi K3 Boosts Throughput to 423 tok/s(8 posts)→
More from Infra
- RTX 5090 hits $7K as PC gaming community goes into 'denial' over AI boom — PAstynome · 2026-10-27
- Wan2GP lands on Pinokio: 1-click AI video on 6GB GPUs — cocktailpeanut · 2026-10-27
- Wan2GP AMD one-click installer lands on Pinokio, runs AI video on 6GB VRAM — cocktailpeanut · 2026-10-27
- AWS on agent prompt caching: explicit + implicit patterns to slash token costs — AWS ML Blog · 2026-10-27
- Thieves spoofing GPS steal $100M+ in data center cargo since June — Ars Technica AI · 2026-10-27
- Lam Research: weekly token usage up ~250x in 18 months — Beth_Kindig · 2026-10-27