RoboDojo robot benchmark under fire: shipped sim tips a grasped bottle 78°, fix keeps it level
YuXiang_IRVL · x · 2026-11-18
Yu Xiang (UT Austin) amplified an analysis by BuiltinPb showing the RoboDojo robot simulation benchmark diverges from reality at almost every link in its chain, from real-world setup to final score.
Key evidence: the same bottle with the same grasp tips 78° in the hand under the shipped configuration, but stays level after a fix. The authors argue rigor is essential when building robot benchmarks, since reported scores can be physically detached from reality.
More from Embodied
- China's Changying-8 cargo drone flies: 3.5t payload, 3000+ km range — prasanna_says · 2026-11-18
- GPT-6.2 Astra reportedly tops RoboDojo-RC Tier 1 real-robot benchmark, beating Dream-1 — scaling01 · 2026-11-18
- Developer uses 6.2 Astra to build a tilt-steering game on a 2-inch ESP32 watch — arbayi · 2026-11-18
- HubLabs' HubEgo-100K robotics dataset trends on Hugging Face — HubLabs · 2026-11-18
- ForceHarness lifts frozen-model robot manipulation success from 3.3% to 90% — showlab · 2026-11-18
- ResWAM: residual learning on frozen DINOv3 boosts VLA success with less compute — OPTML-Group · 2026-11-18