HBF misunderstood: 3TB/s NAND relies on parallelism, not HBM-like behavior
nickbaumann_ · x · 2026-08-22
- HBF misconceptions: High Bandwidth Flash (HBF) isn't an SSD behaving like HBM; the real trick is massive parallelism.
- Read vs. Write: Read aggregate bandwidth can approach HBM levels, but writes remain NAND-bound, a distinction that changes infrastructure implications.
- Scaling context: As models grow (e.g., Grok targeting 8T+ parameters), solving this with infrastructure-layer parallelism techniques is a critical consideration.
More from Infra
- WandB Raises Price to $60/Month, Users Seek Alternatives — CSProfKGD · 2026-08-22
- Article: Why America's Data Center Build-out is Facing Resistance — robleclerc · 2026-08-22
- Modular shares LLVM 2023 talk: Mojo systems programming language explained — clattner_llvm · 2026-08-22
- Chris Lattner: Modular is the "anti AI compiler" — tinygrad-style approaches never scaled — clattner_llvm · 2026-08-22
- Microsoft ONNX Runtime accelerates cross-platform ML inference — microsoft · 2026-08-22
- vLLM Conference next week: co-hosted events with Google, AMD, NVIDIA — vllm_project · 2026-08-22