Harness optimization lifts Harvey legal agent benchmark pass rate from 67.1% to 85.9%
sarahookr · x · 2026-09-10
- New research from Adaption AI (Sudip Roy and Dhruv Batra's team): harness optimization alone moved criterion pass rate from 67.10% to 85.92% on the Harvey Legal Agent Benchmark — a jump of nearly 19 points.
- Adding post-training on top pushed the score to 88.03%.
- Key argument: owning your intelligence means improving both the model and the harness around it. The result quantifies how much leverage agent orchestration/engineering has on end performance.
Related event: Harness optimization lifts legal agent benchmark from 67% to 86%(3 posts)→
More from coding & agent
- Agent Field Kit launches $29 security runbooks for production AI agents — alvelda · 2026-10-27
- Dev mixes Claude specs with abliterated GLM to build SS7 threat detector — l4rz · 2026-10-27
- Cloudflare Durable Objects validated as top architecture for AI agent WebSocket servers — tristanbob · 2026-10-27
- GitHub Next's Chopin prototype explores real-time multiplayer agentic planning — max__drake · 2026-10-27
- Veynod: An Open-Source Shared Workspace Where AI Agents Collaborate Like a Team — TKOWNS · 2026-10-27
- TMLR paper: enforced thinking doesn't reliably make LLM agents disclose key info to users — SharonYixuanLi · 2026-10-27