HBF misunderstood: 3TB/s NAND relies on parallelism, not HBM-like behavior
nickbaumann_ · x · 2026-08-22
- HBF misconceptions: High Bandwidth Flash (HBF) isn't an SSD behaving like HBM; the real trick is massive parallelism.
- Read vs. Write: Read aggregate bandwidth can approach HBM levels, but writes remain NAND-bound, a distinction that changes infrastructure implications.
- Scaling context: As models grow (e.g., Grok targeting 8T+ parameters), solving this with infrastructure-layer parallelism techniques is a critical consideration.
Related event: HBF High-Bandwidth Flash Faces Doubts Over Limited Use Cases(2 posts)→
More from Infra
- Large data centers employ only ~50-150 permanent on-site staff, Microsoft says — brezina · 2026-10-16
- Prediction: Opus 5.5-level models on laptops by 2027, backed by Qwen 27B data — cephaloform · 2026-10-16
- Oracle down 12% in a week, nearly 50% off June high as OpenAI exposure spooks market — alvelda · 2026-10-16
- US data center moratoriums top 400 — an AI bull explains why they're actually good for AI — kevinsxu · 2026-10-16
- Microsoft Research unveils Magnetar, the fastest zkVM at 10-39x speedups and post-quantum security — jedisct1 · 2026-10-16
- Bonsai 2 2B hits 120 tok/s on iPhone 18 Pro, outpaces Qwen 3.5 2B at half the memory — cephaloform · 2026-10-16