Ben Bajarin: Agentic AI Will Drive Datacenter CPU Demand, Scale-Up Domain Is the Key Battleground
BenBajarin · x · 2026-10-06
Analyst Ben Bajarin argues agentic AI will significantly expand datacenter CPU demand, revisiting forecasts from his earlier 'Secret Agent CPU' notes. He contends there will be no standard CPU:GPU ratio—each hyperscaler's mix depends on how it serves inference—and that the scale-up compute domain, not just networking racks together, is priority number one for monetizing inference infrastructure, with interconnect as the key bottleneck. He applauds Marvell for framing the story the same way.
More from Infra
- Mistral Large 4 trained on just 4,000 Grace Blackwell GPUs vs 100,000 for Astra — steipete · 2026-10-07
- SpaceX shows off Starmind plan: 1M-satellite Starlink clusters with 10 Tb/s links for AI compute — XFreeze · 2026-10-07
- OpenSSH shifts to faster releases as AI-discovered security bugs pile up — jedisct1 · 2026-10-07
- Lambda Releases AIPerf: Benchmarking Models Under Real User Workloads — TheZachMueller · 2026-10-07
- Google launches EmbeddingGemma 2, a 740M open multimodal embedding model for on-device use — sundarpichai · 2026-10-07
- GPUs idle 85-95% waiting on memory: why the whole AI stack is being rebuilt — alex_verem · 2026-10-07