OpenAI Has ~1.9 GW of Compute, Wants 30 GW; US Buildout Nears 100 GW
le_james94 · x · 2026-09-26
Notes from Lecture 5 of Stanford's MS&E 435:
- OpenAI controls roughly 1.9 GW of compute and wants 30 GW; planned US build-out approaches 100 GW.
- Latency breakdown: 500ms passes before the first token appears, most of it spent on prefill.
- Key argument: time-to-compute matters more than the raw amount of compute.
More from Infra
- Altman says OpenAI aims to replace Nvidia in the medium to long term — zephyr_z9 · 2026-11-11
- Chinese University Bought Nvidia H200 Chips Despite US Blacklist — pstAsiatech · 2026-11-11
- Baidu's ERNIE Evolve tops public bests on NanoGPT Speedrun, brings RSI to real inference optimization — xiaohu · 2026-11-11
- Baidu says RSI auto-optimized ERNIE inference, 6.24x decode speedup on Kunxin P800 — xiaohu · 2026-11-11
- Nvidia's supply commitments jump from $119B to $279B in one quarter, locking up 2027-28 memory — tengyanAI · 2026-11-11
- Train 27B models on a 24GB GPU: ternary optimizer cuts memory to 1 byte/weight — oguzeldereli · 2026-11-11