Google’s 260-run study finds multi-agent systems can be 80.8% better — or 70% worse
alex_verem · x · 2026-07-25
Google Research, DeepMind, and MIT ran the largest controlled study on multi-agent systems, testing 260 configurations across OpenAI, Google, and Anthropic models on six benchmarks and five architectures with the same tools and compute budgets.
The key takeaway is task-dependent performance:
- For tasks that split into independent pieces, multi-agent teams beat a single agent by up to 80.8%.
- For sequential tasks where each step depends on the last, every multi-agent setup lost to a single agent, by as much as 70%.
- Uncoordinated agents amplified each other's mistakes 17.2×, while a single coordinator reduced that to 4.4×.
- Once a single agent already reached 45% accuracy, adding more agents tended to produce negative returns.
The paper's practical advice is simple: only go multi-agent when the work can truly be partitioned into independent subproblems.
Related event: Google's Massive Experiments Reveal Multi-Agent Systems' Double-Edged Sword(3 posts)→
More from Research
- Scientific AI requires breaking high-probability trajectory dependency and building real-world verification loops — manoelribeiro · 2026-08-25
- WorldMind: Decoupled Game World Model for State-Aware NPC Behavior — Zhiyang Deng · 2026-08-25
- Nature Publishes ML-Based Probabilistic Weather Forecasting — pastramimachine · 2026-08-25
- Moderna reveals how it uses AI to accelerate mRNA vaccine development — alex_verem · 2026-08-25
- AI Cuts Melanoma Recurrence by 49% in Moderna Trial — alex_verem · 2026-08-25
- RL Exercise: Using LLM to guide crossover heuristics for bin packing — cephaloform · 2026-08-25