Unified hand-object model handles 7 tasks, trained on 100K clips mined from unlabeled video
RoozbehMottaghi · x · 2026-11-17
Researchers present a unified hand-object interaction model with two main contributions: (1) a single model supporting 7 tasks — predicting future hand poses, hand articulation and object poses, inferring object motion from hand motion and vice versa, and generating hand/object trajectories conditioned on goals; (2) a scalable pipeline that extracts 3D object poses, hand poses and articulation from unannotated internet videos, yielding a curated dataset of 100K video clips. Paper and code are available.
More from Embodied
- Paper and Code Links for Grasping the Future Released — RoozbehMottaghi · 2026-11-17
- Open-Sourced 3D World Model Predicts Hand-Object Motion From Internet Videos — RoozbehMottaghi · 2026-11-17
- Coco Robotics turns real delivery footage into edge-case training with NVIDIA Cosmos — NVIDIA Developer · 2026-11-17
- NVIDIA's LidarVerse simulates any LiDAR sensor in real time with one world model — NVIDIAAI · 2026-11-17
- Jetson GPIOs now drive $2 L298N motor controllers directly, no Arduino needed — chrismatthieu · 2026-11-17
- UW-led team unveils Grasping the Future, forecasting 3D hand-object motion from internet videos — mangahomanga · 2026-11-17