Success-Guided Sampling: sim-to-real RL nails dexterous assembly with zero demos

kevin_zakka · x · 2026-10-10

UW and NVIDIA researchers (CoRL 2026) release Success-Guided Sampling (SGS), a simple tweak to the task sampler that fixes the exploration bottleneck in mega-scale RL. Policies trained purely in simulation—with no demos, no tactile sensors, no per-task reward tuning—mesh gears, thread nuts, and insert pegs zero-shot on real UR5e/Franka arms from RGB, and a single policy handles ANYmal C/D across extreme terrains. Scales to 1M+ parallel simulated robots using only PPO. Code coming soon.

Related event: Success-Guided Sampling Enables Zero-Real-Data Dexterous Manipulation via Sim-Only RL(2 posts)→

Original post →

More from Embodied

Embodied channel →