RoboDojo: Unified Benchmark for Sim and Real-World Robots

量子位 · wechat · 2026-07-08

The RoboTwin team introduced RoboDojo, a new robotic manipulation benchmark featuring 42 simulated tasks and 18 real-world tasks. It evaluates five core capabilities: generalization, memory, precise manipulation, long-horizon execution, and open-vocabulary semantic understanding. The benchmark highly standardizes real-world evaluations through unified hardware setups, scene resets, and a double-blind scoring mechanism. Under these rigorous tests, the current state-of-the-art generalist robot policy achieved an average success rate of only 8.80% in simulation and a maximum of 12.8% in the real world, compared to a 100% success rate by human experts. This highlights a significant gap between current robotic foundation models and true general physical manipulation.

Related event: RoboDojo: Unified Sim-and-Real Robotics Benchmark(2 posts)→

Original post →

More from Embodied

Embodied channel →