Kimi K3 Scale Exceeds Single B200 Capacity
airesearch12 · x · 2026-07-17
According to SemiAnalysis, the 2.8T parameter scale of Kimi K3 is too large to fit on a single NVIDIA DGX B200, even in FP4.
Deployment requires systems like the GB300 NVL72, B300, or MI355X, as each GPU needs 288GB of VRAM. Optimizing for the B200 might require tying multiple nodes together using WideEP; however, the B200's inter-node bandwidth is only 400 Gbit/s, whereas the NVL72 boasts an inter-node bandwidth 18 times higher.
Related event: Kimi K3 Triggers a Reassessment of Chinese Frontier AI(94 posts)→
More from Infra
- Tabul AI launches Metal TreeSHAP to speed up Shapley values on Apple silicon — Scobleizer · 2026-07-22
- DeepSeek-V4-Flash tops out at 770 tok/s on one B300 in a vLLM batch test — Moreh · 2026-07-22
- NVIDIA starts shipping 102.4 Tbps Spectrum-6 switches for Vera Rubin AI factories — nvidia · 2026-07-22
- Apple publishes SOC 3 audit reports for Private Cloud Compute — throwfaraway4 · 2026-07-22
- Reddit GPU renters say existing platforms only give you two of three: code, recovery, fair billing — legendpizzasenpai · 2026-07-22
- The Sandboxing Manifesto: Secure Execution Environments for Agents — spirosoik · 2026-07-22