Inference capacity is not a liquid market — book 3 months ahead, not 3 weeks
saranormous · x · 2026-08-21
Sara Hooker argues that once a company scales, inference runs into real compute constraints: the inference capacity market is not liquid, and getting capacity on short notice is hard. Locking in capacity 3 months out is far easier than 3 weeks, yet end users don't care — they just expect the service to work. Her advice: stay on good terms with your inference vendor.
Related event: Compute Crunch Spreads to Inference as GPU Capacity Becomes Illiquid(3 posts)→
More from Infra
- Prediction: Opus 5.5-level models on laptops by 2027, backed by Qwen 27B data — cephaloform · 2026-10-16
- Oracle down 12% in a week, nearly 50% off June high as OpenAI exposure spooks market — alvelda · 2026-10-16
- US data center moratoriums top 400 — an AI bull explains why they're actually good for AI — kevinsxu · 2026-10-16
- Microsoft Research unveils Magnetar, the fastest zkVM at 10-39x speedups and post-quantum security — jedisct1 · 2026-10-16
- Bonsai 2 2B hits 120 tok/s on iPhone 18 Pro, outpaces Qwen 3.5 2B at half the memory — cephaloform · 2026-10-16
- Samsung cuts Q4 phone output as Nittobo shifts E-glass to AI-chip T-glass — zephyr_z9 · 2026-10-16