UMI step 3: video+IMU SLAM recovers gripper trajectories under 1cm error

gabriberton · x · 2026-11-03

Step 3 of the UMI pipeline: compute the grippers' trajectories during the task. IMU alone is too noisy, so use a SLAM method fusing video and IMU. The MoCap benchmark figure shows mean SLAM tracking errors of 6.1mm/3.5° per-gripper ATE and 10.1mm/0.8° inter-gripper RPE — under 1 cm and 4° overall.

Related event: UMI: The Data-Collection Foundation Behind Many Robot Startups(6 posts)→

Original post →

More from Embodied

Embodied channel →