Structured conflict beats scaling agents in code review: new study

omarsar0 · x · 2026-08-24

A new paper investigates multi-agent systems for code review, challenging the assumption that "more agents is better" for weak agentic review.

Key Findings:

Diminishing Returns: Scaling agents to large numbers yields diminishing returns on repository-level tasks.
Structured Conflict Works Better: The proposed "Adversarial Review" uses just 3 agents (Coder, Reviewer, Critic) and beats a 5-agent baseline.

Benchmark Results:

LiveCodeBench: The 3-agent adversarial setup outperformed the 5-agent baseline.
SWE-PRBench: A naive version failed as agents converged on agreement without evidence. Making disagreement an explicit instruction recovered the highest F1 score.

Conclusion: Cooperative review works best when disagreement is minimal, structured, and grounded in evidence.

More from coding & agent