Open-weight models are shifting GPU demand from H100s to B200 and B300
AccBalanced · x · 2026-08-04
Open-weight models are shifting GPU demand toward Nvidia’s Blackwell generation.
- GPU requests are moving from H100 by default to B200 and B300.
- The post argues that models such as Kimi K3 and GLM-5.2 ship native FP4 weights, which Blackwell can run in hardware while Hopper must dequantize on the fly.
- Result: roughly 3× better performance per dollar on B200 for the same model.
- The broader point is that open-weight models are accelerating Nvidia’s next hardware cycle, while the H100 resale market is now mostly secondhand.
More from Infra
- Inference engineering is becoming a new middle-layer market in AI — dotey · 2026-08-04
- FlashAttention 2, SGLang and DeepSeek v3 named as modern AI’s most important open-source projects — hyhieu226 · 2026-08-04
- Fluidstack is hiring across dozens of data center roles as it builds gigawatt-scale AI infrastructure — MxMnr · 2026-08-04
- SK hynix and Sandisk publish first HBF specs for AI memory up to 512GB — firstadopter · 2026-08-04
- MiniMax says H3 got day-one support from 100+ partners and top-3 video benchmark scores — MiniMax 稀宇科技 · 2026-08-04
- A reported look at the backlash against AI datacenter buildouts — lennysan · 2026-08-04