vLLM adds day-0 support for Moonshot’s 2.8T-parameter Kimi K3
woosuk_k · x · 2026-07-28
vLLM announced day-0 support for Moonshot AI’s Kimi K3, saying the model can be served as soon as the weights are public.
The post highlights K3’s scale and the supporting engineering work around prefix caching, DSpark training, and kernel optimizations. K3 is described as a 2.8T-parameter MoE model with a 1M-token context window, native multimodal understanding, and Kimi Delta Attention to make long-context inference more affordable.
Related event: vLLM brings day-0 support to Moonshot’s Kimi K3(11 posts)→
More from Infra
- Together AI adds canary rollouts for zero-downtime model upgrades on dedicated inference — togethercompute · 2026-09-23
- Dedicated Hardware for Running AI Agents at Scale Arrives — cyrilzakka · 2026-09-23
- Ternary Bonsai 2 27B: 5.9GB weights retain ~95% of full-precision reasoning — cephaloform · 2026-09-23
- Qwen 27B runs 24hr unattended on one RTX5090, builds full Postgres-SpringBoot-React spreadsheet app — anglepoiselife · 2026-09-23
- OpenRoboto Shift launches: decentralized egocentric video data network for robot brains — markjeffrey · 2026-09-23
- Engineer describes designing digital circuits that recycle most of their energy — MikePFrank · 2026-09-23