Agent Era Reshapes Compute Bottlenecks
coinfanking · reddit · 2026-07-11
This article argues that as AI enters the agent era, the hardware bottleneck shifts from GPU-centric training logic to CPU, memory, and network for running agents.
Key Judgment
- Training was primarily a GPU story; an agent is more like "one task, one set of computation, memory, and communication," thus CPU demand resurges.
- The author expects hardware spending in the agentic era over the next two to three years to be roughly 3x that of the training era.
CPU: The Underestimated Inflection Point
- The article estimates the CPU market could grow from $350-400 billion today to over $2000 billion by 2030.
- Citing Cloudflare: serving 100 million knowledge workers would require about 10 million CPUs; globally, it could be close to 1 billion CPUs.
- The conclusion: 2025 may be the year the CPU demand inflection point truly emerges.
Memory: From Narrative to Financial Reports
- The article highlights Micron's quarterly performance as proof that memory is no longer just narrative but real price and profit.
- Adjusted gross margin is nearly 80%, compared to the historical range of 30%–50%.
- The author states storage prices have risen roughly 7x from the cycle bottom, directing profits to Micron while squeezing budgets of large customers like NVIDIA, Alphabet, and Microsoft.
Structural Changes
- Agents require not only HBM but also standard DRAM and NAND, adding a new demand curve.
- Meanwhile, HBM production consumes significant traditional DRAM capacity, further tightening supply.
- Micron's CEO believes HBM supply shows no clear signs of recovery in the short term; the author projects tightness could extend through 2028.
Contract and Investment Perspectives
- The article mentions that Micron has signed 16 strategic customer agreements, mostly fixed-price, about 3-year terms, totaling at least $100 billion, extending to 2030.
- The author still believes it's better to invest in the equipment chain (e.g., KLA, Lam Research, Applied Materials) rather than directly betting on storage commodities.
Additional Tail Risk/Opportunity
- The end mentions that humanoid robots may require roughly 10x the memory of today's AI systems, potentially extending this cycle into the next decade.
More from Infra
- LLM Serving Metrics Thread: Why TPOT and Uptime Make or Break User Experience — abhijithneil · 2026-09-11
- PlanetScale launches sharded Postgres: 768 servers acting as one, 1PB scale — dhruv2038 · 2026-09-11
- Can a 7900 XTX 24GB run Qwen locally? Reddit seeks ROCm tok/s benchmarks — thenomadexplorerlife · 2026-09-11
- RTK Terminal Compression Cuts Tokens but Leaves Your AI Coding Bill Unchanged — Bartaseth · 2026-09-11
- SF Compute founder: buying compute is 'an absolutely awful experience' right now — IgorCarron · 2026-09-11
- SmolVM open-sources persistent computer infrastructure for agents that outlive chat sessions — aniketmaurya · 2026-09-11