Agents pull AI compute back to the CPU: AWS, Google, Microsoft, NVIDIA all build on Arm

kimmonismus · x · 2026-11-20

The thread argues agent workloads are pulling AI hardware back to the CPU: the model thinks on the GPU, but spinning up sandboxes, running code, calling tools, and deciding next steps all run on the CPU — once per answer for chatbots, looping endlessly for agents. AMD says chatbot-era servers ran 1 CPU per 4–8 GPUs; with agents the ratio moves toward 1:1.

Arm's agent-workload benchmarks of Cobalt 200 vs AMD EPYC Turin: up to 46% more SWE-bench tasks/min, 56% higher Milvus vector search, 57% higher fastText. All four rivals — AWS (Graviton), Google (Axion), Microsoft (Cobalt), NVIDIA (Grace/Vera) — build on Arm; Google alone ported 30,000+ apps, and Arm now sells its own AGI CPU co-developed with Meta.

Original post →

More from coding & agent

coding & agent channel →