NVIDIA's ScheduleGen generates collision-aware multi-arm robot training data via MILP scheduling

AjayMandlekar · x · 2026-10-31

NVIDIA and UT Austin researchers introduce ScheduleGen, a synthetic demonstration-generation pipeline for multi-arm imitation learning. It adapts object-relative contact skills, plans per-arm joint-space paths, and solves a MILP for collision/ordering/synchronization constraints, keeping only validated trajectories. Beyond bimanual setups it covers cluttered shared workspaces, long-horizon contact, four-arm systems, and a fixed-waist humanoid. Across 28 simulation variants it achieves 79.6% mean generation success and 65.5% learned-policy success, with 50–80% real-world success via sim-to-real and real-to-sim-to-real transfer.

Related event: NVIDIA Unveils ScheduleGen for Multi-Arm Robot Training Data(2 posts)→

Original post →

More from Embodied

Embodied channel →