UMI steps 1-2: handheld grippers with cameras and IMUs do real dishes

gabriberton · x · 2026-11-03

Steps 1-2 of the UMI pipeline: hold two grippers, each with a camera and IMU, and perform real tasks like washing dishes, touching objects only with the grippers. The figure shows the UMI demo interface design — a wrist-mounted GoPro fisheye camera, side mirrors for implicit stereo, IMU-aware pose tracking and continuous gripper tracking.

Related event: UMI: The Data-Collection Foundation Behind Many Robot Startups(6 posts)→

Original post →

More from Embodied

Embodied channel →