DexGPT: a GPT-written real2sim pipeline turns one monocular hand GIF into 44-DOF dexterous sim, open-sourced
animesh_garg · x · 2026-09-10
DexGPT shows GPT writing an entire real2sim pipeline from a single monocular GIF of a human hand: hand tracking, IK retargeting to two 22-DOF Sharpa Wave hands, and grasp refinement, with zero human code. Open-sourced, it achieves passive hinge RMSE of 5.18° (<10° target), max penetration 5.62mm (<5mm target), and 99.5% hand contact frames over 203 replayed states in MuJoCo — though the author flags it as experimental and not yet physically validated.
More from Embodied
- First look at Apple's foldable iPhone Duo leaks — pdamodaran · 2026-09-10
- Unitree fully open-sources UnifoLM-WLA-1.0, a 6B humanoid robot foundation model — teortaxesTex · 2026-09-10
- Tesla insiders say Musk is all-in on Robotaxi, with thousands of vehicles targeted this year — FuSheng_0306 · 2026-09-10
- Webots: open-source robot simulator with 4.6k GitHub stars for robots and vehicles — tom_doerr · 2026-09-10
- Madrid to become first European city with autonomous taxi service, CA-plated cars spotted — eherrerosj · 2026-09-10
- Dexory's autonomous robot audits entire warehouses daily, replacing manual stock counts — lukas_m_ziegler · 2026-09-10