MAC Bench: 8-agent teams beat solo agents via headcount, not coordination

gregd_nlp · x · 2026-11-20

Bespoke Labs released Multi Agent Coordination Bench (MAC Bench): twelve natively multi-agent long-horizon tasks measuring how well frontier agent teams coordinate, with tasks and a Harbor-based harness open-sourced under Apache-2.0.

Key findings:

Each task runs in three settings — solo, k agents coordinating over a shared message board (2/4/8), and k agents without coordination — separating headcount gains from coordination gains. The repo includes runnable commands to reproduce with configurable agent count, budget, model, and harness (e.g. claude-code).

Original post →

More from coding & agent

coding & agent channel →