AI Capex is Now Driven by Inference
markjeffrey · x · 2026-07-20
The core viewpoint shared is that the primary driver of AI capex is not training, but inference demand.\n\nThe author argues that while Chinese model training efficiency has proven to be highly competitive, this doesn't mean the model layer competition is over. What is truly exploding is the continuously growing inference demand. Whether users choose Claude or Kimi, the need for inference compute will trend upward long-term, and even hyperscale cloud providers might not be able to absorb all of it alone.
More from Infra
- China’s AI arms race is increasingly defined by chips, data centers, and open models — BenBajarin · 2026-07-22
- Agent search bottlenecks are now about variance, not raw latency — rohanpaul_ai · 2026-07-22
- Gavin Baker argues Nvidia may be one of open source AI’s biggest supporters — GavinSBaker · 2026-07-22
- AI Power Demand Exposes US Energy Gap, Urging Shift from Scarcity to Abundance — bradneuberg · 2026-07-22
- Gavin Baker says Nvidia’s $630B figure would be system revenue, not all Nvidia’s — GavinSBaker · 2026-07-22
- A Firecracker-based platform says it can host 6,000 AI agents on one 256 GB server — maritime_sh · 2026-07-22