vLLM Hits 464 tok/s on Kimi K3 with 4 GB300 Systems
vLLM announced a new decode throughput peak of 464 tok/s for Kimi K3. Achieved using DSpark on 4 GB300 servers in a low-entropy workload with a batch size of 1, the benchmark highlights significant inference performance gains.
2026-07-29 ~ 2026-07-29 · 2 related posts
- Episode 1: vLLM brings day-0 support to Moonshot’s Kimi K3(2026-07-27, 11 posts)
- Episode 2: Kimi K3 Now Available for Inference and Fine-Tuning on Fireworks(2026-07-28, 2 posts)
- Episode 3: Kimi K3 2.8T-Parameter Model Runs on 80 RTX 5090s with Zero HBM(2026-07-28, 8 posts)
- Episode 4: Kimi K3 Open-Weight Release Sparks Debate on Open Source and Infrastructure(2026-07-28, 5 posts)
- Episode 5: Kimi K3 Self-Hosting Can Break Even in Under 100 Days(2026-07-28, 4 posts)
- Episode 6: Tinkering with Local Quantized K3 Inference on Mac Hardware(2026-07-29, 2 posts)
- Episode 7: Kimi K3 Open Weights Demand Data Center Hardware(2026-07-29, 3 posts)
- Episode 8: vLLM Hits 464 tok/s on Kimi K3 with 4 GB300 Systems(2026-07-29, 2 posts)
- Episode 9: Kimi K3 Gets Day-0 vLLM and AMD Support Across Clouds(2026-07-30, 14 posts)
- vLLM hits 464 tok/s on Kimi-K3 with DSpark at batch size 1 — vllm_project · 2026-07-29
- vLLM says Kimi K3 hits 464 tok/s decode throughput with DSpark on 4 GB300s — zhyncs42 · 2026-07-29