AI Capex is Now Driven by Inference
markjeffrey · x · 2026-07-20
The core viewpoint shared is that the primary driver of AI capex is not training, but inference demand.\n\nThe author argues that while Chinese model training efficiency has proven to be highly competitive, this doesn't mean the model layer competition is over. What is truly exploding is the continuously growing inference demand. Whether users choose Claude or Kimi, the need for inference compute will trend upward long-term, and even hyperscale cloud providers might not be able to absorb all of it alone.
More from Infra
- Resin lets an agent build standalone LLM inference engines; vLLM and SGLang optimize DeepSeek kernels differently — AccBalanced · 2026-10-27
- Local benchmark: Flint matches Qwen3.6 quality at 50/52 while running 3.6x faster on M4 Pro — RichardSocher · 2026-10-27
- Anthropic S-1: CSP marketplace revenue jumped from 11% to 48% in three years — AccBalanced · 2026-10-27
- Alchemy adds effect/Workflow support across Durable Objects, Workflows and Lambda Durable Functions — samgoodwin89 · 2026-10-27
- Alchemy's Lambda Web Functions run plain Node web servers on Lambda, no OpenNext needed — samgoodwin89 · 2026-10-27
- Alchemy Cuts Cloudflare Bindings CPU Time by Up to 166× Via Profiling — samgoodwin89 · 2026-10-27