RoboColosseum launches open robot eval with 100+ real robots and 10,000 free eval hours
DJiafei · x · 2026-11-04
BitRobot, Hugging Face, NUS MAGIC Lab and EAIC launched RoboColosseum, an open initiative to evaluate robot policies across tasks, embodiments and real-world settings.
- Scale: 100+ real robots (Unitree G1, LeRobot SO-101, YAM, Franka), 140+ in-the-wild scenes, 30 full-time evaluators working in shifts; 20,000+ trials across 6,800+ tasks already run
- Two tracks: a Fine-tune Track with shared demos and repeatable setups to compare adaptation, and an Open Track pitting models head-to-head on new tasks to test generalization
- Early finding: the first paper shows the best out-of-the-box model may differ from the best after fine-tuning
- Free eval: 10,000 hours of free real-robot evaluation pledged to academic partners
More from Embodied
- RoboColosseum Launches: Open Robot Eval With 100+ Real Robots and 10,000 Free Eval Hours — DJiafei · 2026-11-04
- Training Humanoids in World Models via Differentiable Heightmap Lookups — breadli428 · 2026-11-04
- WayTrace: robot follows web-map walking directions to navigate 2.35 km through Zurich unaided — breadli428 · 2026-11-04
- Two Waymos Box In a Tesla Cybercab in Austin After Wrong-Lane Turn — XFreeze · 2026-11-04
- Sipeed's pocket Linux AI box packs a 256-TOPS Axera NPU and up to 128GB LPDDR5X — DeliciousBelt9520 · 2026-11-04
- The Trinity couples verifiable world generation with agent harness evolution, gaining +26 on unseen benchmarks — YangYou1991 · 2026-11-04