Six Coding Agents, One Repo: Isolated Runs All Broke, Chatting Agents All Passed
jokiruiz · reddit · 2026-10-02
Open-source experimenter jokiruiz stress-tested multi-agent collaboration on a tiny booking API (6 tasks, 37 acceptance tests, two semantically colliding pairs):
- Isolated branches: every agent passed its own tests, but all 5 merged runs broke — Git merged the text; nobody noticed the meaning changed (one agent added 2FA login while another's export still called the old one)
- Shared working directory: all 10 runs passed, since agents could see and adapt to each other's changes
- He also tried Jev, a "decision model" that returns a yes/no collision verdict with probability in 0.3s before each write. It caught every real conflict without blocking harmless work, at file-lock cost — but was unsure about 61% of real writes, which needed a slower regular LLM. Cheap decisions aren't that cheap in messy settings
- Surprise: agents given a messaging tool used it unprompted — one warned another before renaming a field it depended on
His tentative takeaway: multi-agent coordination may need no referee kernel, just agents that talk. Small sample (1-5 runs per setup); raw data MIT-licensed in the medula repo.
More from coding & agent
- shadcn boosts @uisdk: one-shot UI rebuild that's instantly E2E-testable by AI — shadcn · 2026-11-16
- AI agent deletes 43,599 lines of OpenClaw test code in one PR — vincent_koc · 2026-11-16
- JPMorgan shows Jarvis, its internal agent assembly line, at Interrupt NYC — LangChain · 2026-11-16
- Dev clarifies: Apple doesn't ban feature flags, only fooling App Review — talkaboutdesign · 2026-11-16
- Antigravity Matches Claude Cowork in Tests, While Gemini Tasks' Purpose Remains Unclear — sebajun2 · 2026-11-16
- One 16GB GPU runs songs, voice, images, 720p video and local RAG — all offline and open source — llama-of-death · 2026-11-16