RLM harness lifts M&A diligence pass rate from 23.3% to 62.4% across seven models
a1zhang · x · 2026-09-09
- nikogrupen, with Baseten and Baselabs, built an RLM harness for M&A diligence: a root agent delegates document review to sub-agents and aggregates their findings.
- Harness design: across seven models, moving from a standard tool loop to the RLM harness raised mean criteria pass rate from 23.3% to 62.4%.
- Post-training: in a separate experiment, RL on Qwen3.5 inside the RLM harness more than doubled rubric pass rate, starting from 29.9%.
- The results show model-harness co-optimization delivering concrete gains on end-to-end legal workloads.
Related event: Harvey's post-trained RLM agent boosts M&A due diligence pass rate(3 posts)→
More from coding & agent
- SF 'Code Engineering' event picks up where 1,000-person harness engineering meetup left off — LangChain · 2026-10-27
- Prompt turns Claude Code into an iPhone backup forensics tool exposing 30-day 'deleted' photo copies — alex_verem · 2026-10-27
- Prompt turns Claude Code into a forensics tool finding deleted iPhone photos in backups — alex_verem · 2026-10-27
- Phones won't be mobile IDEs but control planes for agent fleets, argues Yuchen Jin — Yuchenj_UW · 2026-10-27
- FrontierCS 2 launches on Kaggle: 48 tasks make agents beat published CS papers — MeganRisdal · 2026-10-27
- Stop remaking old games with AI: a call for more ambitious agentic software — rschu · 2026-10-27