DIY GPT-5.5 code review team beats Cursor Bugbot on a 50-PR benchmark
s0ck_r4w · hn · 2026-07-24
What the post shows
A DIY code review team built from three GPT-5.5 reviewers — bug-hunter, keeper, and sweeper — beat Cursor Bugbot and CodeRabbit on Martian’s Open Code Review Bench.
Key details
- The setup is intentionally simple: the three reviewers are all the same model, and the only difference is their review focus.
- The author then runs the team three times and keeps only findings that appear in all three runs.
- On 50 real PRs, the system reached 0.463 F1, ahead of Cursor Bugbot (0.445) and CodeRabbit (0.352).
- The main takeaway is that customizing a review workflow to a codebase may matter more than elaborate personas.
Why it matters
The post argues that building your own review stack on top of existing harnesses is still underexplored, and that off-the-shelf review tools may not be enough for teams that want tighter codebase-specific tuning.
More from coding & agent
- Warp's six non-engineering teams all run on Linear and Claude Code — mon__lim · 2026-09-11
- Is inference latency becoming the biggest bottleneck for production AI agents? — Euphoric_Sea632 · 2026-09-11
- Anthropic researcher: 99% of engineers now run swarms of 300+ self-improving agents — AlishaOutridge · 2026-09-11
- Gergely Orosz: Shipping 10x PRs With AI Agents, Sites Fill With Small Regressions — ducha_aiki · 2026-09-11
- Same Echo Maze prompt, three frontier models: all passed visually but shipped the same hidden bug — eyishazyer · 2026-09-11
- Astra storyboards plus Minimax H3 per-shot generation boost video success rates — Hailuo_AI · 2026-09-11