CMU paper: RL-trained 4B proposer edits agent harness code, beats its 35B teacher
omarsar0 · x · 2026-10-04
A new CMU paper introduces "harness learning": improving agents by editing their harness code instead of their weights.
- An RL-trained proposer model reads a task, the current harness, and an execution report, then writes a code edit to the harness
- The reward is the revised harness's score; the solver model never changes
- The trained 4B proposer beats its 35B teacher at single-step revision on Reasoning Gym, including task families unseen in training
- A proposer trained on HotpotQA keeps improving harnesses on MuSiQue and 2WikiMultihopQA
The authors highlight editing harness code as an emerging AI engineering skill, a shift they see accelerating.
Related event: Harness Learning: 4B Model Rewrites Agent Code, Beats 35B Teacher(3 posts)→
More from coding & agent
- TanStack AI adds experimental text-to-GLB 3D model and prompt-to-motion animation generation — bennash · 2026-11-20
- Dev builds typing survival game with troops and skill trees in ~24 hours using agents and kaigen3d — hullabaloo22 · 2026-11-20
- Harmonic's Aristotle writes proven-correct fusion plasma controllers in C and Verilog in 4 hours — satnam6502 · 2026-11-20
- R3 Code: A Native Rust Mac Client That Runs All Your Coding Agents — jasonkneen · 2026-11-20
- zlib: 2.4K-star open-source CLI turns Z-Library into a skill for AI agents — udmrzn · 2026-11-20
- Andriy Burkov's True Positive Weekly #186: what to know when agents do the work — burkov · 2026-11-20