NVIDIA open-sources Isaac Video to enable Real-to-Sim-to-Real robot learning workflow
Scobleizer · x · 2026-08-22
NVIDIA has released the open-source NVIDIA Isaac Video project, aiming to bridge the gap between real-world demonstrations and robot training through a Real-to-Sim-to-Real workflow.
Key capabilities include:
- Video Ingestion: Segmenting long videos and retrieving relevant action clips automatically.
- Reconstruction: Reconstructing hand/body motion, depth, meshes, and 6-DoF trajectories.
- Retargeting: Mapping human motions to robot embodiments for RL policy training in Isaac Lab.
- Dexterity: Scaling dexterous manipulation using Contact Wrench Guidance From Human Demonstration (CHORD).
The release also provides access to a library with 1,215 tasks and 121,500 robot episodes.
More from Embodied
- Robotics LLMs tested on 16 tasks: GPT-6 Astra hits 17.2% success vs Fable's 9.1% — pabbeel · 2026-10-16
- WEDGE paper generates training environments conditioned on navigation agent failures — _akhaliq · 2026-10-16
- Viral meme nails AI's irony: it can write symphonies but can't do the dishes — briannekimmel · 2026-10-16
- Knödel Watch: animated vocabulary cards on ESP32-S3, open-sourced 4 days after unboxing — alexcovo_eth · 2026-10-16
- NVIDIA RTX Spark PC launches tomorrow with global events and strong early reviews — NVIDIA Blog · 2026-10-16
- SlipSense fuses pressure and vibration for 23ms zero-shot robotic slip detection — micoolcho · 2026-10-16