Kimi K3 Scale Exceeds Single B200 Capacity
airesearch12 · x · 2026-07-17
According to SemiAnalysis, the 2.8T parameter scale of Kimi K3 is too large to fit on a single NVIDIA DGX B200, even in FP4.
Deployment requires systems like the GB300 NVL72, B300, or MI355X, as each GPU needs 288GB of VRAM. Optimizing for the B200 might require tying multiple nodes together using WideEP; however, the B200's inter-node bandwidth is only 400 Gbit/s, whereas the NVL72 boasts an inter-node bandwidth 18 times higher.
Related event: Kimi K3 Triggers a Reassessment of Chinese Frontier AI(94 posts)→
More from Infra
- LLM Serving Metrics Thread: Why TPOT and Uptime Make or Break User Experience — abhijithneil · 2026-09-11
- PlanetScale launches sharded Postgres: 768 servers acting as one, 1PB scale — dhruv2038 · 2026-09-11
- Can a 7900 XTX 24GB run Qwen locally? Reddit seeks ROCm tok/s benchmarks — thenomadexplorerlife · 2026-09-11
- RTK Terminal Compression Cuts Tokens but Leaves Your AI Coding Bill Unchanged — Bartaseth · 2026-09-11
- SF Compute founder: buying compute is 'an absolutely awful experience' right now — IgorCarron · 2026-09-11
- SmolVM open-sources persistent computer infrastructure for agents that outlive chat sessions — aniketmaurya · 2026-09-11