Huawei Rumored Scale-Up Node with 4,096 Accelerators Could Pack 384TB of HBM

zephyr_z9 · x · 2026-09-17

Back-of-envelope math on the Huawei scale-up rumor: at fp4, one copy of large model weights needs 20TB of HBM. Assuming each hypothetical XPU carries 4GB × 4Hi × 6 stacks = 96GB of HBM, a 4,096-accelerator scale-up node would total 4096 × 96 = 384TB — though the 4Hi assumption itself is disputed.

Related event: Rumor: Huawei to expand supernode to 4096 cards with 384TB HBM(2 posts)→

Original post →

More from Infra

Infra channel →