Inference demand went vertical, yet is a flat line next to post-training/RL growth
zainhas · x · 2026-10-11
zainhas notes that inference demand has gone vertical over the past year, yet on a chart of overall compute growth it appears as a flat line next to the explosive growth of post-training and RL compute. The chart implies post-training/RL stages are now the dominant driver of AI compute demand growth.
More from Infra
- AirLLM runs 70B models on a 4GB GPU via layer-wise inference, scaling to 405B on 8GB — JensHonack · 2026-10-11
- Speech Model Shrunk 13x to 153M Params by Looping 2 Shared Blocks — pbaylies · 2026-10-11
- Pat Gelsinger slams HBM as "a lousy memory" wasting four bits for every one it makes — SumitGup · 2026-10-11
- Qualcomm CEO predicts AI phone supercycle, smart glasses as top AI wearable — SuB8u · 2026-10-11
- Zero cold starts: Building and shipping MCP servers with WebAssembly, Spin and Akamai Functions — AI Engineer · 2026-10-11
- Hugging Face launches a PyTorch profiling series: from torch.profiler to attention — ariG23498 · 2026-10-11