OpenAI Has ~1.9 GW of Compute, Wants 30 GW; US Buildout Nears 100 GW
le_james94 · x · 2026-09-26
Notes from Lecture 5 of Stanford's MS&E 435:
- OpenAI controls roughly 1.9 GW of compute and wants 30 GW; planned US build-out approaches 100 GW.
- Latency breakdown: 500ms passes before the first token appears, most of it spent on prefill.
- Key argument: time-to-compute matters more than the raw amount of compute.
More from Infra
- 1Cat-vLLM fork revives decade-old V100s: Qwen3.6-35B benchmark numbers shared — Miserable-Dare5090 · 2026-09-26
- DeepSeek reportedly runs smaller-model inference on NVIDIA gaming GPUs, argues Teortaxes — teortaxesTex · 2026-09-26
- Price of intelligence collapsing 13x per year, says blogger citing Epoch AI data — LeviTurk · 2026-09-26
- Moody's Warns Anthropic and OpenAI Carry $2.5T in Off-Balance-Sheet Debt — SumitGup · 2026-09-26
- SemiAnalysis Maps 1,000+ China Datacenters Across 60+ Operators in New AI Infrastructure Model — zephyr_z9 · 2026-09-26
- Everything About Hosting Got Cheaper Except Moderation: LessWrong Burns ~$1M/Year — jd_pressman · 2026-09-26