Kimi K3 Available on Baseten with vLLM-Powered Production API
vllm_project · x · 2026-07-30
The vLLM project officially announced that the Kimi K3 model is now available via Baseten's production API. Baseten uses vLLM as part of its inference stack, allowing users to call the 2.8-trillion-parameter model without managing the underlying infrastructure themselves.
Related event: Kimi K3 Gets Day-0 vLLM and AMD Support Across Clouds(14 posts)→
More from Infra
- Qualcomm goes agent-centric: Snapdragon 8 Elite Gen 6 and agent-native devices — jiqizhixin · 2026-09-23
- Unsloth Desktop Hotfix Adds Qwen-Image-2.1 Image Editing and Fixes GGUF Loading — danielhanchen · 2026-09-23
- Qwen 3.6 35B-A3B Q6 hits ~50 tok/s on a 128GB Strix Halo — what's the best local model now? — jankeydankey · 2026-09-23
- Together AI adds canary rollouts for zero-downtime model upgrades on dedicated inference — togethercompute · 2026-09-23
- Dedicated Hardware for Running AI Agents at Scale Arrives — cyrilzakka · 2026-09-23
- Ternary Bonsai 2 27B: 5.9GB weights retain ~95% of full-precision reasoning — cephaloform · 2026-09-23