Real2Gym Turns Videos Into Interactive Robot Gyms, Beating GPT-6 Direct Mode by 33% on Real Robots
Shanghai-AI-Laboratory · hf · 2026-09-30
Shanghai AI Laboratory's Real2Gym is an agentic Real2Sim2Real framework that converts human and robot manipulation demos into interactive simulation gyms and transfers learned skills to real robots. It reconstructs editable scenes, validates actions via physics execution, and distills successes and failures into reusable procedures and recovery strategies—without weight updates. It outperforms GPT-6 Astra Direct Mode by 16.7% in reconstruction success with 74.9% fewer tokens, and by 33.3% on real Franka execution across four tasks.
More from Embodied
- YC-backed Ornadyne's flapping-wing drone was classified as a bird by Air Force detectors — import_jmr · 2026-11-16
- Uber starts offering Amazon's Zoox robotaxi rides in Las Vegas — Polymarket · 2026-11-16
- Ant Lingbo Embodied AI Challenge crowns TARS team after 48-hour real-robot hackathon — 新智元 · 2026-11-16
- Tesla FSD fleet tops 7 billion city miles, adding ~500M in under four weeks — XFreeze · 2026-11-16
- Ropedia Releases Xperience 2: 1,500+ Scanned Real-World Scenes Paired With Egocentric Demos — liuziwei7 · 2026-11-16
- Hangzhou's Manycore Tech launches Aholo MS07 3D laser scanner with CHCNAV — teortaxesTex · 2026-11-16