DIY GPT-5.5 code review team beats Cursor Bugbot on a 50-PR benchmark
s0ck_r4w · hn · 2026-07-24
What the post shows
A DIY code review team built from three GPT-5.5 reviewers — bug-hunter, keeper, and sweeper — beat Cursor Bugbot and CodeRabbit on Martian’s Open Code Review Bench.
Key details
- The setup is intentionally simple: the three reviewers are all the same model, and the only difference is their review focus.
- The author then runs the team three times and keeps only findings that appear in all three runs.
- On 50 real PRs, the system reached 0.463 F1, ahead of Cursor Bugbot (0.445) and CodeRabbit (0.352).
- The main takeaway is that customizing a review workflow to a codebase may matter more than elaborate personas.
Why it matters
The post argues that building your own review stack on top of existing harnesses is still underexplored, and that off-the-shelf review tools may not be enough for teams that want tighter codebase-specific tuning.
More from coding & agent
- NVIDIA says Nemotron 3 Ultra hit 97.1% on agentic RTL chip-design tasks — NVIDIAAI · 2026-07-27
- Tokyo Agent Forge hackathon shipped production-ready AI agents in one day — DavidBennett__ · 2026-07-27
- Long-running agents will need immutable event logs, this thread argues — sebpaquet · 2026-07-27
- Agentic Data Science in Practice: Agents Write Code but Answer Wrong Questions — hugobowne · 2026-07-27
- A VS Code extension adds Markdown-style highlighting to Alchemy string templates — samgoodwin89 · 2026-07-27
- Claude’s Stripe MCP connector is being called unusable after repeated disconnects — evielync · 2026-07-27