UW/Ai2's s³ trains role-free LLM swarms that beat best-of-N via cooperative multi-agent RL

StellaLisy · x · 2026-11-07

Researchers at UW and Ai2 introduce s³ (Simple Scaling of Swarms via Cooperative Multi-agent RL): swarms of N copies of one LLM with no leader, no prescribed roles, and no turn order. Agents share one team reward and freely message each other, with organization emerging from training rather than hand-designed orchestration. Key claims: first method training asynchronous role-free LLM swarms to beat best-of-N solo agents under the same budget, and the edge persists when scaling beyond the number of agents seen in training. Motivated by failures of fixed structures — duplicated work, message overload, unreconciled subagents. Paper and project page are live; code coming soon.

Related event: UW and Ai2 Release s³: Self-Organizing LLM Swarms via Multi-Agent RL(3 posts)→

Original post →

More from coding & agent

coding & agent channel →