RoboColosseum details: 5 VLAs ranked across 20,000+ real-world runs
DJiafei · x · 2026-11-06
Official thread on RoboColosseum, the open robot eval initiative by Hugging Face, BitRobot Network, EAIC and others: 100+ robots, 140+ in-the-wild scenes, open rollout data and 10,000 free eval hours. Two tracks—blind open-world zero-shot and in-distribution fine-tuned performance. Across 20,000+ runs, policy rankings varied by task and robot. Five VLAs evaluated so far, including MolmoAct2, GR00T N1.7, π0.5 and LingBot.
More from Embodied
- Four of six AGIBOT G2 humanoids survive a 24-hour convenience store shift — AIFlow_ML · 2026-11-06
- Encord debuts REACH egocentric hand-tracking model, cutting errors up to 70% — Scobleizer · 2026-11-06
- BCI report: first approved invasive brain implant sold 13 units, the real action is outside hospitals — melnykowycz · 2026-11-06
- Hugging Face co-founds RoboColosseum: 100+ real robots, failures included, all open — DJiafei · 2026-11-06
- University of Michigan's 26-lecture robotics math course (ROB 501) is free on YouTube — techNmak · 2026-11-06
- RLWRLD turns human demo videos into robot training data with NVIDIA Cosmos — NVIDIA Developer · 2026-11-06