Dev ditches unanimous-vote stopping rule for a judge in multi-AI debate project
lluisantoni · reddit · 2026-10-30
The author's side project Chat Brawlers has three models answer independently, read each other's responses, debate, and vote. The original design mistake: treating model agreement (unanimous votes) as the stopping condition — but all three could give the same answer (e.g. "Use Postgres") while each voting for itself, producing a pointless tie. The fix: after each round, a separate judge compares their conclusions; if the conclusions match, the debate ends even with split votes. The trade-off is that the judge may overlook important conditions ("Use Postgres" vs "Use Postgres unless X"), though in practice it has caught these nuances so far.
More from coding & agent
- Tokyo Agent Hackathon: 40+ builders burn 580M tokens in 5 hours, ship 20+ projects — DavidBennett__ · 2026-10-30
- One-person AI music video: Suno + Hermes Agent + ComfyUI on a single RTX 3090 — Ok-Wolverine-5020 · 2026-10-30
- Many 'dumb agent' complaints are retrieval problems: RAG tool scores — rcleffke · 2026-10-30
- 1,656 commits in a month mocked as slop — CodeSandbox CEO jokes his own image is ruined — zeeg · 2026-10-30
- Self-Direction turns agent mistakes into LoRA lessons, lifting GAIA success from 38.8% to 55.8% — rohanpaul_ai · 2026-10-30
- Projection mapper open-sources ComfyUI node pack that drafts full light shows locally on 12GB laptops — Puzzled_Parking2556 · 2026-10-30