TRL and OpenEnv now let you train coding agents end to end with opencode
SergioPaniego · x · 2026-07-24
- The post says you can now train your own coding agents with TRL + OpenEnv, starting from opencode.
- The new setup adds end-to-end support for training agent harnesses: TRL launches the agent inside an OpenEnv session, captures its trace, reconstructs training samples, and trains with AsyncGRPO.
- OpenEnv acts as the OpenCode harness environment plus a transparent proxy that records each turn’s token IDs and logprobs.
- The key idea is to train the actual agent loop “as is,” so the policy learns from the exact tokens it produced while using tools.
- They also mention a self-contained example using a local subprocess sandbox and DeepCoder problems, validated on Qwen3-8B.
Related event: TRL and OpenEnv Enable Custom Agent Harness Training(4 posts)→
More from coding & agent
- alphaXiv open-sources OpenResearch to run parallel research agents with any model — alphaXiv · 2026-09-11
- MathModelAgent gains traction: auto-solves math modeling and writes a submission-ready paper — jihe520 · 2026-09-11
- DeskcommCRM: open-source AI sales CRM with native agents and WhatsApp hits 1k stars — melgarafael · 2026-09-11
- hyperresearch: agent-driven knowledge base that turns web research into a searchable wiki — jordan-gibbs · 2026-09-11
- Forter's 13 lessons from its agent sprint: skip custom RAG, lean on mature enterprise search — bibryam · 2026-09-11
- Two real 'company brains' opened up live: Gorgias' in-house Cortex vs Slite — femke_plantinga · 2026-09-11