Microsoft Open-Sources OpenForgeRL for Training Complex Agents in Native Environments
microsoft · hf · 2026-07-25
Microsoft released OpenForgeRL, an open-source framework designed to tackle the challenge of end-to-end training for modern AI agents that rely on complex inference harnesses (like Claude Code and Codex).
Core Mechanism
- Decoupled Training & Inference: It uses a lightweight proxy to record model calls from real harnesses as training data, executing rollouts in isolated remote Kubernetes containers.
- Compatibility: Integrates smoothly with standard RL codebases like veRL, enabling scaled training across any environment.
Performance
- Tool-based Agents: Trained on only hundreds to thousands of tasks, OpenForgeClaw achieved 55.9 pass@3 on ClawEval and 33.7 on QwenClawBench.
- GUI Agents: OpenForgeGUI outperformed similarly sized baselines and matched or surpassed much larger models on OSWorld-Verified (37.7) and Online-Mind2Web (63.0).
Key Findings
The research highlights that harness choice significantly impacts learning difficulty. While RL notably improves agentic reliability (e.g., self-verification, tool coverage), critical abilities like error recovery remain weak.
Related event: Microsoft Open-Sources OpenForgeRL for End-to-End Agent Training(4 posts)→
More from coding & agent
- Chaining dependent MCP tool calls: no rollback, duplicate risk — agentrsdg · 2026-09-11
- DeepMind-led paper makes design docs the source of truth, code disposable — SMART regenerates in 1.5-3h for ~$100 — Roger_M_Taylor · 2026-09-11
- Agent-built classifier labels 192k docs for $0.70 vs $13-26 with frontier LLMs — vanstriendaniel · 2026-09-11
- MathModelAgent gains traction: auto-solves math modeling and writes a submission-ready paper — jihe520 · 2026-09-11
- alphaXiv open-sources OpenResearch to run parallel research agents with any model — alphaXiv · 2026-09-11
- DeskcommCRM: open-source AI sales CRM with native agents and WhatsApp hits 1k stars — melgarafael · 2026-09-11