Rubin Architecture Data Center Costs Surge
tengyanAI · x · 2026-07-14
A Morgan Stanley report indicates that the cost per gigawatt (GW) of computing power has risen by approximately 40% from GB200 to Vera Rubin. This cost surge is primarily driven by inflation in out-of-rack power delivery and infrastructure deployment.
- Memory Costs: In the Rubin architecture, memory's share of the rack BOM is expected to jump from single digits to roughly 25% (nearly tripling), marking a significant increase.
- Out-of-Rack Costs: Measured in cost per megawatt (MW), the current generation is about $11-13 million, while the next generation will increase to $16-19 million. Estimates show this accounts for 31%-37% of the total GB200 cost and 41%-49% of the GB300 cost, making it a larger cost driver than memory.
More from Infra
- CoreWeave 5-year CDS spikes to ~1,100bps as market fears AI bubble starts as credit event — kimmonismus · 2026-10-26
- NVIDIA Plans ~$2,000 Per GPU Per Year Software Fee for Running AI Agents — LinusEkenstam · 2026-10-26
- 12 DevOps concepts to learn in order, from Linux to SRE — _jaydeepkarale · 2026-10-26
- Killed our Vector DB for SQLite BM25 and wrote a 3.6ns Rust sentinel: lessons from multi-agent loops — OpenComplaint524 · 2026-10-26
- Gemma 4 26B-A4B runs offline on a 16 GB Mac: 33/40 on TypeScript tasks at 31 tok/s — Mission-Sir-1614 · 2026-10-26
- How thousands of GPUs train one AI: a breakdown of 5D parallelism — jbhuang0604 · 2026-10-26