Agent Era Reshapes Compute Bottlenecks
coinfanking · reddit · 2026-07-11
This article argues that as AI enters the agent era, the hardware bottleneck shifts from GPU-centric training logic to CPU, memory, and network for running agents.
Key Judgment
- Training was primarily a GPU story; an agent is more like "one task, one set of computation, memory, and communication," thus CPU demand resurges.
- The author expects hardware spending in the agentic era over the next two to three years to be roughly 3x that of the training era.
CPU: The Underestimated Inflection Point
- The article estimates the CPU market could grow from $350-400 billion today to over $2000 billion by 2030.
- Citing Cloudflare: serving 100 million knowledge workers would require about 10 million CPUs; globally, it could be close to 1 billion CPUs.
- The conclusion: 2025 may be the year the CPU demand inflection point truly emerges.
Memory: From Narrative to Financial Reports
- The article highlights Micron's quarterly performance as proof that memory is no longer just narrative but real price and profit.
- Adjusted gross margin is nearly 80%, compared to the historical range of 30%–50%.
- The author states storage prices have risen roughly 7x from the cycle bottom, directing profits to Micron while squeezing budgets of large customers like NVIDIA, Alphabet, and Microsoft.
Structural Changes
- Agents require not only HBM but also standard DRAM and NAND, adding a new demand curve.
- Meanwhile, HBM production consumes significant traditional DRAM capacity, further tightening supply.
- Micron's CEO believes HBM supply shows no clear signs of recovery in the short term; the author projects tightness could extend through 2028.
Contract and Investment Perspectives
- The article mentions that Micron has signed 16 strategic customer agreements, mostly fixed-price, about 3-year terms, totaling at least $100 billion, extending to 2030.
- The author still believes it's better to invest in the equipment chain (e.g., KLA, Lam Research, Applied Materials) rather than directly betting on storage commodities.
Additional Tail Risk/Opportunity
- The end mentions that humanoid robots may require roughly 10x the memory of today's AI systems, potentially extending this cycle into the next decade.
More from Infra
- AI datacenters hit diseconomies of scale as inference shifts demand smaller — abhiadesai · 2026-07-22
- Nothing phone mockup turns a film joke into a modular design meme — ZeYanjie · 2026-07-22
- Actual Computer says its inference stack is tuned for Nvidia’s consumer Blackwell lineup — markjeffrey · 2026-07-22
- Ben Bajarin says CPU demand is still being badly underestimated — BenBajarin · 2026-07-22
- An energy model says the U.S. could run short of natural gas starting in 2028 — churchkey · 2026-07-22
- Devin adds e2b sandboxes for remote agent execution — badphilosopher · 2026-07-22