Simulated GitHub run by agents shows AI-agent collaboration follows its own scaling laws
tongshuangwu · x · 2026-09-03
Researchers built 'Software World' — a GitHub simulated by agents, sub-sampled from real Python dependency data — and deployed agent teams to optimize code efficiency, studying large-scale agent collaboration.
Key findings
- Agents identify code deficiencies and produce patches individually
- Meaningful collaboration emerges: agents ask downstream (agent) maintainers which code paths matter before optimizing
- Upon upstream changes, downstream agents measure gains against their own code and report back numbers
- Collaboration quality varies significantly by base model
Evaluation: held-out downstream packages serve as extrinsic evaluation — if the ecosystem improves, they should benefit too.
Microsoft researcher Tongshuang Wu: agent-maintained repos inherit the same dynamics as human ones, and 'agent-agent collaboration has its own scaling laws.'
More from coding & agent
- Open models below 4-bit struggle at self-iterating 3D asset generation, HF dev finds — mervenoyann · 2026-10-21
- Developer Moves AI Agents to a Dedicated Linux Workstation Using Incus System Containers — kevinkern · 2026-10-21
- Motion Launches a General Video Agent That Edits Footage and Mimics Any Reference Style — mhdfaran · 2026-10-21
- MCP Platform NitroStack Wins Product Hunt Product of the Day, Focuses on Retention — EstablishmentFun4373 · 2026-10-21
- CodeRabbit Ships 5,000 PRs a Week With a Tiny Team, Hires by Strategy-Game Hours — omojumiller · 2026-10-21
- LukeW maps the five UI problems every AI-native company faces with agents — LukeW · 2026-10-21