RoboColosseum launches real-robot benchmark: zero fully completed G1 tasks in 625 trials
DJiafei · x · 2026-11-05
RoboColosseum is a new open initiative for testing robot AI on physical hardware, publicly backed by Unitree, offering 100+ robots (G1 humanoids, SO-101 arms, YAM, Franka), 140+ real-world scenes, and 10,000 free evaluation hours for academic researchers, with recordings released for inspection. Participants include Hugging Face, BitRobot, the Singapore Embodied AI Centre and researcher Jiafei Duan; developers can just submit a policy for real-hardware deployment. Initial results expose a big gap between partial progress and completion: the initial G1 benchmark recorded zero fully completed tasks across 625 trials, even after fine-tuning on 100 demonstrations per task.
More from Embodied
- CoRL paper GUILD: actively guiding robot data collection toward useful auxiliary tasks — RobobertoMM · 2026-11-05
- TAMPAgent at CoRL: coding agents + TAMP planning for zero-shot long-horizon mobile manipulation — dhadfieldmenell · 2026-11-05
- Raven Prism launches: a full Linux computer in glasses, controlled by eyes and voice — Scobleizer · 2026-11-05
- Johns Hopkins hosts 'Embodied AI in Healthcare' symposium on December 14 — mdredze · 2026-11-05
- How Hugging Face rebuilt robotics open source in 3 years, from LeRobot to RoboColosseum — DJiafei · 2026-11-05
- The CERN analogy fits robot evaluation: shared hardware, protocols and published failures — DJiafei · 2026-11-05