Hugging Face turns Claude Code, Codex and 10 coding harnesses into open RL environments

huggingface · x · 2026-10-05

Hugging Face CEO Clément Delangue announced that Claude Code, Codex, Hermes, Pi, opencode and other coding harnesses can now be used directly as RL training environments — no harness or training code changes, fully open source. Key insight: the same model scores 62% under Mini-SWE-Agent but only 33% under Claude Code, meaning most RL training happens in scaffolds nobody ships. The fix is a capture proxy speaking the 4 major agent API formats (OpenAI Chat Completions/Responses, Anthropic Messages, Gemini), forwarding to vLLM, recording exact token IDs and logprobs, and handing trainable sequences to TRL. Ten harnesses already run through it.

Related event: HuggingFace Turns Claude Code, Codex and 8 Other Coding Tools into RL Training Environments(2 posts)→

Original post →

More from coding & agent

coding & agent channel →