RoboColosseum runs 5,699 real-world robot comparisons across 124 sites to benchmark VLA policies

DJiafei · x · 2026-11-05

RoboColosseum, an open robot eval initiative by Hugging Face, BitRobot Network and others, benchmarks physical intelligence in the wild: 5,699 real-world robot comparisons across 124 sites, evaluating 5 VLA policies and 3 frontier AI agents.

Scale: access to 100+ robots (Unitree G1s, LeRobot SO-101s, YAMs, Franka and more), 140+ in-the-wild scenes, open rollout data, and 10,000 free evaluation hours — aiming to map the true state of robot foundation and agentic models.

Original post →

RoboColosseum runs 5,699 real-world robot comparisons across 124 sites to benchmark VLA policies

More from Embodied