RoboTok: Rice and NVIDIA's internet-scale engine retrieves human demo videos for robot learning
CSProfKGD · x · 2026-09-05
Researchers at Rice University with NVIDIA introduce RoboTok, an internet-scale data engine that represents videos as canonicalized 3D hand trajectories in actor-centered reference frames, enabling viewpoint-invariant retrieval of manipulation-relevant web videos as training demonstrations. It outperforms existing robot-data retrieval approaches on benchmarks and improves downstream dexterous policy success, with paper, code and models released.
More from Embodied
- Robotics team signs purpose-built real-world agentic robot — yunta_tsai · 2026-09-05
- Tesla's RIM process kills the paint shop, shrinking Cybercab factory footprint ~50% — elonmusk · 2026-09-05
- XDOF, 3 months out of stealth, in talks for Series B at $1.2B valuation — ZeYanjie · 2026-09-05
- AMD unveils Threadripper Halo Station: 96-core CPU plus MI350P cards with 288GB HBM3E — Aroochacha · 2026-09-05
- Transformer Transformer: design a full robot from one manipulation demo, 73% tracking error cut — SongShuran · 2026-09-05
- AirSim co-creator: we used to pay thousands of dollars to Unreal designers for training environments — sytelus · 2026-09-05