China may need 300M inference chips by 2030 as token demand explodes
pstAsiatech · x · 2026-08-21
Addressing the compute squeeze, an expert warns that existing inference technology cannot sustain token demand growth, predicting China might need 300,000 high-end chips for inference by 2026 and 300 million by 2030—a figure deemed unrealistic. Daily token calls in China have surged over 1,000-fold since early 2024, exceeding 140 trillion in March, driven by the shift towards agentic AI.
More from Infra
- NVIDIA Details Qwen3.8-2.4T Deployment on GB300, Achieving >4K Tokens/s per GPU — PyTorch · 2026-08-21
- SpaceX launch cadence could enable 12-50 GW of space compute — teortaxesTex · 2026-08-21
- Local AI Coding Hardware Tiers: $1k Gets You the Smartest Model — nickbaumann_ · 2026-08-21
- Cerebras officer Sean Lie files to sell $153M in shares as IPO retail buyers get crushed — firstadopter · 2026-08-21
- Fable launches enterprise safeguards running on your infrastructure for data control — trq212 · 2026-08-21
- IOTA SN9 tests decentralized training of 16B model on mixed GPU clusters — bittingthembits · 2026-08-21