Open-Source RL Framework Miles v0.1 Ships: 1,326 Commits, 85 GPU E2E CI Tests, Firecracker Sandbox Rollouts
ying11231 · x · 2026-08-19
radixark launched Miles v0.1, an open-source RL framework for LLMs and multimodal models: fully asynchronous training with fast, flexible rollouts. Built over 9 months by 72 contributors (1,326 commits, 85 GPU end-to-end CI tests), it has been battle-tested on frontier open models like Kimi K3, DeepSeek V4, Qwen 3.8 and GLM 5.2, and powers production RL at humansand, Decagon, IBM, Nebius and more, on both NVIDIA and AMD hardware, with SGLang as native rollout engine.
AgentENV integration: AgentENV serves as Miles' sandbox backend, giving every rollout an isolated, fast-starting Firecracker microVM. Validated in a sustained GRPO run across the full Terminal-Bench-2 suite: GLM-4.7-Flash on 8×H200s, 3,400 episodes across 55 rollouts, with a single m7i.metal-24xl AgentENV server sustaining 64 concurrent environments — sandbox startup is no longer the bottleneck.
Related event: Open-source RL Training Framework Miles v0.1 Released(5 posts)→
More from coding & agent
- Crusoe releases integrations cookbook for Cursor, Zed, and OpenAI-compatible API — darian314 · 2026-08-19
- Designing Loops for Production-Grade Coding Agents: A Case Study — JosephJacks_ · 2026-08-19
- GPT-5.6-Sol Generates Single-File Real-Time 2D Fluid Sim — scaling01 · 2026-08-19
- RadAgent demonstrates reasoning in medical AI — Michael_D_Moor · 2026-08-19
- LLMs Can't Explain Code Decisions; Excessive Comments Might Be a Feature — idanbeck · 2026-08-19
- RAG design case: Ask LukeW citations link directly to video timestamps — LukeW · 2026-08-19