Nvidia's NVHBM Brings 30% More Bandwidth to NVLink Fusion; Amazon Annapurna First Partner
nordicinst · x · 2026-08-27
NVIDIA officially expanded NVLink Fusion with NVHBM, a custom high-bandwidth memory technology, with Amazon's Annapurna Labs as the first collaborator.
Key points: traditional HBM places the memory controller on the XPU die, consuming compute silicon. NVHBM integrates NVIDIA's custom memory controller into the HBM base die (same tech as future NVIDIA GPUs), delivering versus standard HBM4E:
- Up to 30% greater memory bandwidth
- 15% lower HBM power consumption
- Up to 25% more area freed on the XPU compute die
NVIDIA will standardize NVHBM across multiple memory providers, cutting qualification effort so NVLink Fusion customers can bring semi-custom AI chips to market faster.
Related event: NVIDIA Unveils NVHBM Custom Memory, Boosting Bandwidth 30%(2 posts)→
More from Infra
- NVIDIA Unveils NVHBM: 30% Higher Bandwidth and 15% Lower Power — zephyr_z9 · 2026-08-27
- Nikesh Shora predicts NeoCloud valuations will drop below current levels in 2 years — salgar · 2026-08-27
- Data Centers Revitalized Quincy: Poverty Dropped to 6.2% and Property Taxes Fell — robleclerc · 2026-08-27
- vLLM x NVIDIA Dynamo Meetup Attracts 1,600 Signups — vllm_project · 2026-08-27
- Inference companies add 40% margins on rented GPUs, unlikely to last — AccBalanced · 2026-08-27
- Nvidia/Mellanox engineer explains why this network architecture is a bad idea — AccBalanced · 2026-08-27