Kimi K3 Launches with Day 0 Support on AMD Instinct via vLLM
vllm_project · x · 2026-07-30
vLLM officially announced that the Kimi K3 model supports AMD Instinct hardware from day zero. Thanks to vLLM's adaptation to ROCm, developers can efficiently deploy and serve the full 2.8 trillion parameter model on AMD hardware right from the start. Broader performance tuning for AMD Instinct is also actively in progress.
Related event: Kimi K3 Gets Day-0 vLLM and AMD Support Across Clouds(14 posts)→
More from Infra
- Qualcomm goes agent-centric: Snapdragon 8 Elite Gen 6 and agent-native devices — jiqizhixin · 2026-09-23
- Unsloth Desktop Hotfix Adds Qwen-Image-2.1 Image Editing and Fixes GGUF Loading — danielhanchen · 2026-09-23
- Qwen 3.6 35B-A3B Q6 hits ~50 tok/s on a 128GB Strix Halo — what's the best local model now? — jankeydankey · 2026-09-23
- Together AI adds canary rollouts for zero-downtime model upgrades on dedicated inference — togethercompute · 2026-09-23
- Dedicated Hardware for Running AI Agents at Scale Arrives — cyrilzakka · 2026-09-23
- Ternary Bonsai 2 27B: 5.9GB weights retain ~95% of full-precision reasoning — cephaloform · 2026-09-23