Daniel Lemire: AI is exploding demand for boring compute, server CPUs to double

lemire · x · 2026-11-02

Computer scientist Daniel Lemire makes a counterintuitive point: AI's biggest compute impact isn't GPUs but plain, boring compute. His AWS bills rose because designing, deploying, and stress-testing services has never been easier — previously idle servers now run endless valuable work. The accompanying DIGITIMES chart forecasts global server CPU shipments growing from 28.4M units in 2025 to 36.1M in 2026 and 52.6M in 2027, driven by agentic AI, inference workloads, and higher CPU-to-GPU ratios. He concedes AI-driven software optimization may eventually curb hardware growth, but warns we must avoid compute becoming the next "big oil."

Original post →

More from AGI Musings

AGI Musings channel →