Real2Sem2Real turns one phone video into 2,000+ robot demos, matching 150 teleop demos
Scobleizer · x · 2026-10-27
- Problem: Can a robot handle coffee mugs and machines it has never seen after watching a human do the task once?
- Method: Real2Sem2Real takes one phone video plus a video scan of the objects and turns it into 2,000+ robot demos across task cousins.
- Results: Across nearly 2,000 real-world rollouts on two robots, it matches or beats 150 teleoperated demos.
- Takeaway: Massively cheaper demonstration data collection for robot imitation learning, no teleop rig required.
More from Embodied
- Re-uploading a 239GB robot dataset moved only 2.6MB — inside a petabyte-scale data pipeline — mervenoyann · 2026-10-27
- ROSCon UK photo tour: BBC's whale robot, da Vinci surgical robot and the OG PR2 — kamathsblog · 2026-10-27
- Teardown of a humanoid robot Z-axis linear actuator, with Zmotor Q&A — MarwaEldiwiny · 2026-10-27
- GPT-6 Astra Beats Gemini 3.8 Flash in Paired Robot Test, Yet Neither Completes the Task — qinzytech · 2026-10-27
- Teardown of Zmotor LA500 humanoid linear actuator: 324 g, 500 N peak thrust — MarwaEldiwiny · 2026-10-27
- LIBERO-MAX: Robot Policies Drop 11–26 Points When the World Changes Mid-Task — drmapavone · 2026-10-27