HotChips Take: HBF Limited to Sparse Attention, Efficiency > Cost

BenBajarin · x · 2026-08-24

Analysis from HotChips 2026 suggests HBF is overhyped. While offering high capacity and low cost, its use is limited to areas like Sparse Attention (DeepSeek/ZAI style) or Expert parallelism. The metric of tokens per second per watt is argued to be more critical than cost per GB.

Related event: HBF High-Bandwidth Flash Faces Doubts Over Limited Use Cases(2 posts)→

Original post →

More from Infra

Infra channel →