Coding agents generate robot training data: VLA finetuned on agent demos runs on real hardware
Haoxiang You · hf · 2026-09-24
Researchers present EmbodiedSWE, a framework studying whether coding agents can solve long-horizon dexterous robotics tasks and turn verified solutions into scalable supervision for general robot policies.
Key contributions:
- EMBODIEDSWE-BENCH: a simulation benchmark spanning contact-rich manipulation, deformable objects, and long-horizon tasks requiring up to 30 minutes of continuous interaction. Frontier coding agents solve complex tasks and transfer solutions across tasks and embodiments.
- EMBODIEDSWE-GEN expands a single agent solution into large, diverse trajectory datasets for training VLAs. Performance scales with more demonstrations, and agent-aided diversification improves generalization to held-out task variations.
- A VLA finetuned solely on coding-agent-generated simulation demonstrations completes a long-horizon task on a real robot.
The framework uses coding agents to solve robotics tasks and convert verified solutions into scalable policy supervision.
Related event: EmbodiedSWE: Coding Agents Tackle Long-Horizon Robot Tasks(3 posts)→
More from coding & agent
- Resend joins Stripe Projects: one CLI command wires email into AI agent workflows — jeff_weinstein · 2026-09-24
- MiniMax Code tested: building and deploying a full site from a single prompt — nikola_mr64990 · 2026-09-24
- Agent Reliability QA: The Next AI Category Is Stress-Testing Agents, Not Building Them — DevWithTea123 · 2026-09-24
- Privacy Middleware Concept: Anonymize Sensitive Data Locally Before It Reaches LLMs — Ai_MOON_SHOT · 2026-09-24
- No-BS guide to agent harness engineering: context, guardrails, and feedback — Pavan_Belagatti · 2026-09-24
- Claude Code Projects adds local support: threads can now run on your own machine — bcherny · 2026-09-24