RoboDojo robot benchmark under fire: shipped sim tips a grasped bottle 78°, fix keeps it level

YuXiang_IRVL · x · 2026-11-18

Yu Xiang (UT Austin) amplified an analysis by BuiltinPb showing the RoboDojo robot simulation benchmark diverges from reality at almost every link in its chain, from real-world setup to final score.

Key evidence: the same bottle with the same grasp tips 78° in the hand under the shipped configuration, but stays level after a fix. The authors argue rigor is essential when building robot benchmarks, since reported scores can be physically detached from reality.

Original post →

More from Embodied

Embodied channel →