Kimi K3 with 2.8T parameters and 1M context now supported on vLLM

ricklamers · x · 2026-07-27

vLLM announces Day-0 support for Moonshot AI's Kimi K3, one of the most powerful open-weight models. K3 features 2.8T parameters (MoE, 16/896 experts active), 1M context window, native multimodal understanding including vision, and Kimi Delta Attention (hybrid linear and full attention) for affordable long context. Thanks to partners Moonshot, inferact, NVIDIA, AMD.

Original post →

More from Models

Models channel →