AMD MI355X Beats NVIDIA B200 in Kimi K3 Deployment with 952 tok/s
adrianscottcom · x · 2026-08-03
Engineers successfully deployed the Kimi K3 model on a single AMD MI355X server. Leveraging AMD's memory advantage, the single node achieved a total throughput of 952 tok/s and 118 tok/s for a single user.
Tests show this node's total throughput is nearly 4x that of a 16×B200 setup, with better performance per dollar than both B200 and B300. Additionally, AMD's ROCm stack proved mature, working mostly out-of-the-box with only minor fixes needed.
Related event: AMD MI355X Outperforms NVIDIA B200 in Kimi K3 Deployment(4 posts)→
More from Infra
- Google TPU Demand Surge: Projected to Reach 15M Units by 2028 — SumitGup · 2026-08-03
- Run 2.78T Parameter Kimi K3 on a Single CPU in 8.24GB RAM — Saboo_Shubham_ · 2026-08-03
- tinygrad Teases Local Deployment Product, Hints at Upcoming Qwen3.6-27B — max_paperclips · 2026-08-03
- Qwen3.8-27B Open Weights Coming, Runs Locally on 17GB RAM — danielhanchen · 2026-08-03
- AirLLM Breaks VRAM Barrier: Runs 70B LLMs on a Single 4GB GPU — techNmak · 2026-08-03
- MiniMax H3 Open Weights Hit fal with Out-of-the-Box Inference Optimizations — gorkem · 2026-08-03