Microsoft's ProgramDistill turns interactive web apps into verifiable SWE training tasks
_akhaliq · x · 2026-09-27
Microsoft's Debug Gym team released ProgramDistill, a pipeline that converts interactive web apps into verifiable, reference-guided software engineering tasks for training and benchmarking coding agents.
Companion resources include the arXiv paper, a blog post, the ProgramDistill-Bench dataset on Hugging Face, and a public leaderboard.
It offers a new recipe for generating large-scale, gradable SWE tasks for agent training and evals.
More from coding & agent
- Sydney Codex Community Buildathon set for Nov 14 with Cerebras-backed ultrafast compute track — paw_lean · 2026-11-11
- shadcn's improve hits 10k stars: let top models plan, cheap models execute code fixes — shadcn · 2026-11-11
- OpenAI open-sources Codex Security CLI and SDK for AI-driven vulnerability scanning and fixing — openai · 2026-11-11
- Claude Opus 5.5 runs an architecture search and finds AttnRes-Canon, a new top Transformer design — SonglinYang4 · 2026-11-11
- 5 research habits worth knowing: read papers backwards, reproduce first, wire coding agents via MCP — cneuralnetwork · 2026-11-11
- 'Adam can now do CAE': AI agent showcase in engineering simulation draws buzz — burhop · 2026-11-11