RLM harness lifts M&A diligence pass rate from 23.3% to 62.4% across seven models
a1zhang · x · 2026-09-09
- nikogrupen, with Baseten and Baselabs, built an RLM harness for M&A diligence: a root agent delegates document review to sub-agents and aggregates their findings.
- Harness design: across seven models, moving from a standard tool loop to the RLM harness raised mean criteria pass rate from 23.3% to 62.4%.
- Post-training: in a separate experiment, RL on Qwen3.5 inside the RLM harness more than doubled rubric pass rate, starting from 29.9%.
- The results show model-harness co-optimization delivering concrete gains on end-to-end legal workloads.
Related event: Harvey's post-trained RLM agent boosts M&A due diligence pass rate(3 posts)→
More from coding & agent
- 'My intelligence stack': developer splits AI coding work across Opus 5.5, Fable and Astra with human review gates — sh_reya · 2026-10-27
- Baseten webinar: evaluate open models for coding agents by benchmarking on your own merged PRs — baseten · 2026-10-27
- Thorsten Ball on working with agents: run more evals, automate everything, use the best models — omarsar0 · 2026-10-27
- Where to draw the approval line for scheduled agent jobs — Reddit discussion — MemStrata · 2026-10-27
- 4 MCP servers worth a look: full-text YouTube search, Chrome session reuse, Framer editing — Prior_Engineering486 · 2026-10-27
- DeepMind paper: LLMs can't sample randomly on their own — pass random numbers from code instead — rohanpaul_ai · 2026-10-27