HIL-UMI: Robots Learn From Handheld Demos Without Touching Real Hardware

jiqizhixin · x · 2026-10-19

Qiyuan Robotics' Dong Hao team presents HIL-UMI (ArXiv 2609.20659), which collects training experience on a handheld device—no real robot execution needed during data collection.

The system systematically compares what the human demonstrator does against what the current policy would do, flagging states where the gap exceeds a threshold and prompting the operator to keep recording from that state until the step completes. Validated with π0.5 on a Franka arm across four tasks.

Original post →

More from Embodied

Embodied channel →