NVIDIA NVHBM custom memory boosts bandwidth by 30%, cuts power by 15%

NVIDIA Blog · rss · 2026-08-27

NVIDIA expanded its NVLink Fusion architecture with NVHBM, a next-gen high-bandwidth memory technology. By integrating the memory controller into the 3D HBM stack instead of the XPU, NVHBM delivers up to 30% greater bandwidth, 15% lower power consumption, and frees up 25% more area on the compute die compared to standard HBM4E. Amazon's Annapurna Labs will be the first to adopt NVHBM for its next-generation Trainium chips.

Original post →

More from Infra

Infra channel →