Hugging Face to release all RoboColosseum robot eval rollouts, including failures
micoolcho · x · 2026-11-13
Wrapping up CoRL, Hugging Face's Pepijn announced that every RoboColosseum eval rollout will be released, including failures. The benchmark's organizers stress that while an LLM can be benchmarked from a laptop, robot policies require real hardware and environments — RoboColosseum provides real robots operated by independent operators in new scenes, since domain experts need to see how models actually behave.
More from Embodied
- Google details privacy protections for its intelligent eyewear — rseroter · 2026-11-13
- CoRL 2026 wraps up with birthday tribute to Dieter Fox turning 60 — DJiafei · 2026-11-13
- 4D Surgical launches MRI-compatible robotic surgery arms with $8M seed round — Scobleizer · 2026-11-13
- Ken Goldberg Coins "Variational Automation" to Describe Embodied AI's Niche — ZeeshanZiaML · 2026-11-13
- Watching an AI learn to walk, trained with fable 5.2 — imjustnewatai · 2026-11-13
- First day with iPhone Duo: wow at 5 minutes, hate at 1 hour, hooked by day's end — talkaboutdesign · 2026-11-13