Ben Bajarin: Agentic AI will spawn an 'agentic native' CPU tier in datacenters
BenBajarin · x · 2026-09-20
Ben Bajarin highlights his 'Secret Agent CPU' thesis from March, predicting a coming CPU supercycle driven by agentic AI.
The core argument: the shift from monolithic LLM inference to multi-step agentic workflows structurally changes datacenter compute mix. When agents call tools, query databases, wait for human approval, or orchestrate sub-agents, GPUs sit idle while CPUs do the work — an idle window estimated at 12–22% of total inference time, scaling with agent complexity.
His modeling: a fully loaded CPU rack costs $300K (up to $500K in bullish scenarios) vs $4M+ for a GPU rack, with 7:1 power draw ratio. Allocating 5% of power to CPUs in a 1GW facility yields 2% higher effective token throughput and 3.7% lower cost per token for only 1.7% more capex. Breakeven sits near a 10% allocation. He expects a new 'agentic native' CPU tier to emerge alongside GPU clusters.
More from AGI Musings
- EA Community Erupts Over Philosopher's Argument That Insect Lives May Be Net Negative — teortaxesTex · 2026-09-20
- Beff Jezos: AI cannot be controlled by a Berkeley ideological cluster or committee — beffjezos · 2026-09-20
- Eric Schmidt: UIs will largely disappear as agents make 90% of web traffic non-human — rohanpaul_ai · 2026-09-20
- AI researcher argues humans' decorrelated skills beat AI at market-driven role matching — QuintinPope5 · 2026-09-20
- Luiza Jarovsky: AI won't kill all humans by 2030, but could destabilize global systems — AlexTensor · 2026-09-20
- Investor: personal AI assistants have arrived, generative streaming takes off in 2027 — annbordetsky · 2026-09-20