DexGPT: a GPT-written real2sim pipeline turns one monocular hand GIF into 44-DOF dexterous sim, open-sourced
animesh_garg · x · 2026-09-10
DexGPT shows GPT writing an entire real2sim pipeline from a single monocular GIF of a human hand: hand tracking, IK retargeting to two 22-DOF Sharpa Wave hands, and grasp refinement, with zero human code. Open-sourced, it achieves passive hinge RMSE of 5.18° (<10° target), max penetration 5.62mm (<5mm target), and 99.5% hand contact frames over 203 replayed states in MuJoCo — though the author flags it as experimental and not yet physically validated.
More from Embodied
- RealSense D585 Pro AI-Powered 3D Stereo Depth Camera Unboxed for Physical AI — chrismatthieu · 2026-10-26
- Physical world agent swarm demo shared on X — pduan · 2026-10-26
- Looking for a wearable mic with best battery life that feeds recordings to personal agents via MCP — altryne · 2026-10-26
- 'Lamp Swarm': a desk of lamp-shaped robots shows what physical AI work looks like — dee_hw · 2026-10-26
- Tencent's HiSTEVE 1.0: hierarchical VLA agent plays Minecraft with native keyboard and mouse, hits 85% SOTA — _akhaliq · 2026-10-26
- SJTU's VaM lets robots learn online from mistakes, 95%+ success over 4-hour autonomous runs — chris_j_paxton · 2026-10-26