AI agents run in multi-step loops, demanding a fundamentally different infra stack
sarahookr · x · 2026-09-02
Sarah Guo argues agents are reshaping inference workloads: historical AI workloads are predictable continuous matrix multiplication, while agents operate in multi-step loops—execute an action, check for success, adjust course. Like a cookie recipe requiring repeated oven in-and-out, the bottleneck shifts from getting dough to the oven to the check-and-reinsert cycle. This requires a fundamentally different infrastructure setup.
More from coding & agent
- Anthropic borrows lawyers' ethics for Claude agents that closed 186 deals with no human approval — rohanpaul_ai · 2026-10-18
- Prompt injection via email can hijack your AI agent — jev-guard adds risk-scored guards — sujingshen · 2026-10-18
- 14-Agent AI Film Pipeline on One RTX 5090: Fixing Cut Defects Between Clips — developervkmp · 2026-10-18
- Meta paper introduces "agent plasticity": best-performing agent isn't the most efficient learner — rohanpaul_ai · 2026-10-18
- Dev ships a bushfire prediction platform in a weekend with frontier models — CtrlAltDwayne · 2026-10-18
- 10 open-source GitHub repos that let AI agents control your phone, from Open-AutoGLM to mobile-use — victor_explore · 2026-10-18