Microsoft's FrogNano trains a 4B coding agent almost entirely with RL, no teacher model
ossm-me · reddit · 2026-09-10
A new report called FrogNano from Microsoft Research Montréal's Froggy Team, with collaborators from Mila and UC San Diego, refines Qwen3.5-4B into a small coding agent using reinforcement learning — with no human-labeled data and no larger teacher model providing answers.
Key points:
- All learning comes from synthetic software engineering tasks generated and trained across roughly 1,500 environments over repeated rounds;
- The core contribution is task difficulty curation: tasks that are too easy teach nothing, too hard yield no reward, and learning only happens in a narrow middle band;
- The system keeps generating new tasks matched to the model's improving skill, and the authors argue difficulty matching matters more than raw task count.
The stated goal is a coding assistant that runs on limited hardware. It's an early report rather than a finished model, but clearly presented and carefully tested.
Related event: Microsoft's FrogNano: A 4B Coding Agent Trained with Pure RL(6 posts)→
More from coding & agent
- Krea Releases Krea Agents, Autonomous Agents Built for Creative Workflows — angrypenguinPNG · 2026-09-10
- Most AI agents lack memory—what's missing is a write path, not a bigger context window — minchoi · 2026-09-10
- Free DeepLearning.AI course teaches agents to turn their own traces into reusable skills — minchoi · 2026-09-10
- Kernel and Link let browser agents pay online without ever touching card data — jeff_weinstein · 2026-09-10
- RobustSGPO lifts agent harness completion from 60% to 80% on held-out tasks — dair_ai · 2026-09-10
- Kling MCP tutorial shows how to keep character identity consistent across shots — SimplyAnnisa · 2026-09-10