HUG uses 1M egocentric frames to train zero-shot robot grasping
chris_j_paxton · x · 2026-07-25
RoboPapers highlights HUG (Human Universal Grasping), a method for learning robot grasping from egocentric human video alone.
Key points:
- The team collects 1M frames / 27.8 hours of egocentric human grasping video.
- They train a flow-matching model to predict human hand pose.
- Those predicted hand poses are then retargeted to robot hands.
- The approach reportedly brings large gains on a range of zero-shot robot grasping tasks in everyday scenes.
The episode features @kevinywu, @irmakkguzey, and @DandanShan discussing the work and why human video may be a scalable substitute for scarce robot data.
More from Embodied
- Humanoid walking is continuous correction — watch recovery, not locomotion, in demos — Olivier__OG · 2026-10-26
- CircuitHub unveils The Grid, a factory-scale robot making PCBs in the US twice as fast as Shenzhen — garrytan · 2026-10-26
- AI researchers guessed robots wouldn't outrun humans until 2034 — it already happened — ben_j_todd · 2026-10-26
- Shanghai AI Lab-led team releases 100-hour egocentric wearable dataset for humanoid training — ChuckDBrooks · 2026-10-26
- RealSense D585 Pro AI-Powered 3D Stereo Depth Camera Unboxed for Physical AI — chrismatthieu · 2026-10-26
- Physical world agent swarm demo shared on X — pduan · 2026-10-26