Alibaba Uses World Models for Digital Teleoperation
量子位 · wechat · 2026-07-17
Alibaba DAMO Academy proposed RynnWorld-Teleop, shifting from "human teleoperating a real robot" to "human gestures driving a generative world model." The system directly synthesizes first-person robot video in a digital world and automatically generates joint-level action labels.
The article details three key conditions and implementations of this digital teleoperation: first-person robot perspective, traceable actions, and real-time interaction. The corresponding tech includes depth-aware skeleton rendering, progressive cross-domain training, and distilling a bidirectional video diffusion model into a causal student model running at 40FPS in real time.
In experiments, data generated by RynnWorld-Teleop can directly train real robot policies. For bimanual dexterous hand tasks, usable policies were achieved with zero real-world data. When synthetic data was mixed with real-world data, success rates improved further across most tasks, proving the synthetic trajectories closely match real data in both pixels and feature distribution.
More from Embodied
- ROS names Alejandro Hernández Cordero new project lead, eyes 2027 release — ___Mufasaa · 2026-10-27
- ROS Meetup coming to Google's NYC office Oct 29 with speakers from Tangent, Cohesive Robotics, Intrinsic — kscottz · 2026-10-27
- Tesla officially expands robotaxi service area across much of Houston, Texas — Polymarket · 2026-10-27
- Walden Robotics teaches robots to call for help, blending remote assist with autonomy — adnothing · 2026-10-27
- Folding-screen hinges: dozens of ultra-precise parts, one grain of sand can kill the panel — BenBajarin · 2026-10-27
- No π0 weights changed: Motoniq layer lifts real-robot precision fitting from 0/10 to 9/10 — hbouammar · 2026-10-27