JoMoHa jointly RL-trains model and harness, hits 97.0% on ALFWorld

omarsar0 · x · 2026-11-13

Salesforce AI Research and HKU introduce JoMoHa, the first framework to jointly RL-train an executable harness-generation policy and a task-execution policy, enabling recursive self-improvement. Naively alternating updates causes model–harness incompatibility, with performance rising then falling; keeping separate histories and value estimates per policy fixes this. JoMoHa beats weight-only and harness-only baselines, averaging 70.3% across ALFWorld, WebShop, and DBBench, and reaching 97.0% on ALFWorld vs 90.5% for a frozen engineer.

Original post →

More from coding & agent

coding & agent channel →