Andrew Ng: one of my agents makes 5,000–10,000 web searches a day, data centers will need to scale far beyond current plans
DeepLearningAI · x · 2026-10-10
In this week's Batch letter, Andrew Ng argues most people still underestimate the data center build-out agents will require.
- Search: one of his agents (paperreview.ai) makes roughly 5,000–10,000 web search calls a day, far more than he does manually; a single consumer chatbot prompt can trigger multiple search calls.
- Storage & analytics: he uses coding agents to add analytics instrumentation, then agents to analyze the data — agents will store, retrieve, and analyze far more data than humans, driving memory and long-term storage demand.
- Analogy: online banking forced banks to re-architect infrastructure as transactions exploded; agent-driven financial transactions will do the same to banks again.
This issue also covers OpenAI's DevDay, Google's first Gemini 4 model, Black Forest Labs moving into robots, FLUX 3 Action, and the HYSET toolkit.
More from Infra
- llama.cpp only hits 8-10 t/s on a 4bit 27B while bitsandbytes + transformers manages 27 t/s — cephaloform · 2026-10-10
- Two H100 price indices show just 0.17 weekly correlation, clouding compute futures hedge — BenBajarin · 2026-10-10
- Chrome's new echo canceller halves voice agent word error rate, stops agents answering their own greeting — chadwallacehart · 2026-10-10
- Price war math: does cheaper AI tokens boost or drain compute investment? — dnlkwk · 2026-10-10
- New Paper 'Inference Auctions' Brings Market Mechanisms to LLM Inference Serving — nhaghtal · 2026-10-10
- SGLang-Diffusion serving framework for diffusion models to be unveiled at PyTorch Conference 2026 — PyTorch · 2026-10-10