HBM Value Per Nvidia AI Server Expected to Quintuple
firstadopter · x · 2026-07-08
Bank of America predicts that the dollar value of HBM memory per rack will jump from about $150,000–$300,000 in the Blackwell era to roughly $400,000 for the next-generation Vera Rubin. This means HBM memory will account for a significantly larger share of costs in a single Nvidia AI server, making memory an increasingly expensive component of the AI compute supply chain.
More from Infra
- Surprising Ubuntu Setup: NVIDIA 5090 PC Becomes the Easiest AI Rig — _xjdr · 2026-07-27
- TSMC reportedly plans 5%–10% price hikes in 2027 to cover rising costs — Beth_Kindig · 2026-07-27
- Anthropic says Claude Code can drop 80% of its system prompt with no coding loss — krishnan · 2026-07-27
- Dhruv Bhatia joins fal to work on video and world models — gorkem · 2026-07-27
- Moonshot’s Kimi K3 lands on Together with reserved throughput and 65% lower cost — togethercompute · 2026-07-27
- NVIDIA says Vera CPU is speeding up next-gen CPU and GPU design cycles — nordicinst · 2026-07-27