ClawGym II paper: Improving agents via mixed-harness training
omarsar0 · x · 2026-08-19
The paper 'ClawGym II' introduces a method to train agents using existing code harnesses like OpenClaw and Claude Code. By placing a serving proxy at the model boundary, the system captures tool calls and organizes them into prefix trees, allowing PPO and GRPO to optimize over the multi-turn structure. Results show Qwen3-30A3B gained significant Pass@1 improvements (+9.98 via OpenClaw, +14.81 via Claude Code). The study also demonstrates that mixed-harness training leads to policies that generalize across different execution systems rather than overfitting to a single one.
Related event: RUC's ClawGym II Trains Agents via Black-Box RL on Real Harnesses(3 posts)→
More from coding & agent
- Meta open-sources Muse Spark Open agent model with day-0 TPU support in SGLang — BanghuaZ · 2026-10-16
- Saying "load-bearing" in your prompt makes Opus 5.5 stop holding back — zacharynado · 2026-10-16
- You.com partners with Paperclip to give every agent live web access — PolarBearby · 2026-10-16
- I priced every Grok Bot call: $20 to $200 plan in 5 days, long jobs eat 52% — jonathanmalkin · 2026-10-16
- GitHub is criminally underrated as a free data store, devs argue — blelbach · 2026-10-16
- Claude Desktop doesn't support MCP sampling — here's a workaround for two-way MCP apps — wuj · 2026-10-16