Sarah Hooker: AI agents are the second major driver reshaping compute workloads
sarahookr · x · 2026-09-02
Sarah Hooker argues AI agents are the second major driver of compute demand. Historically, training and inference were predictable, continuous matrix multiplications—like a factory with one oven and one recipe, where only data delivery speed mattered. Unlike training, test-time compute doesn't need tight co-location: parallel agent calls tolerate individual failures, letting developers distribute workloads across hardware of different sizes and locations without penalty—reshaping how inference infrastructure gets built.
More from AGI Musings
- The infiltrator's burden: paranoid AI agents from the HF attack give defenders an asymmetric edge — robleclerc · 2026-09-03
- '90% of work is too vague to even be wrong': researchers slam rigor turning into entertainment — RexDouglass · 2026-09-03
- Hospitals Are Using AI to Raise Prices, Argues Antitrust Commentator Matt Stoller — GaryMarcus · 2026-09-03
- Cooperative AI Summer School 2026 releases talks, gathered 45 early-career researchers — xuanalogue · 2026-09-03
- AI diffusion debate: digital tech now spreads with or without human adoption — soleio · 2026-09-03
- AI agents break the internet's three-layer transaction fraud validation chain — arampell · 2026-09-03