RoboTryOn turns human videos into robot demos, lifting success rate from 2% to 60%

kaist-ai · hf · 2026-11-04

KAIST and RLWRLD's RoboTryOn treats human-to-robot video translation as virtual try-on: it swaps the human for a reference robot while preserving motion, scene and objects, then infers actions via an inverse dynamics model. Policies trained purely on synthetic data improve novel-task success from 2% to 60% (including bimanual manipulation), matching teleoperated-data performance at 1/3 the collection cost.

Original post →

More from Embodied

Embodied channel →