Kimi K3 Hits 423 tok/s with SGLang Integration

Kimi K3 has achieved Day-0 support on SGLang, reaching 423 tok/s on the GSM8K benchmark by utilizing a DSpark speculator draft model trained with SpecForge to optimize decoding throughput.

2026-07-28 ~ 2026-07-28 · 4 related posts