Reality Check launches first public robot manipulation benchmark with 14,400 real-world rollouts
DJiafei · x · 2026-09-29
Nicolas Keller's team launched Reality Check, a public leaderboard and the first public robot manipulation benchmark. Key facts:
- 14,400 real-world rollouts across four models, multiple tasks and data regimes, including object placement tasks
- Results reported with confidence intervals; tests run on FR3 Duo stations
- Commenter DJiafei notes MolmoAct2 is SOTA on this new benchmark and calls this "the year of RoboEval"
The launch signals robotics is entering a systematic benchmark era akin to LLM evaluations.
Related event: Reality Check Launches First Public Real-Robot Manipulation Leaderboard(2 posts)→
More from Embodied
- YC-backed Ornadyne's flapping-wing drone was classified as a bird by Air Force detectors — import_jmr · 2026-11-16
- Uber starts offering Amazon's Zoox robotaxi rides in Las Vegas — Polymarket · 2026-11-16
- Ant Lingbo Embodied AI Challenge crowns TARS team after 48-hour real-robot hackathon — 新智元 · 2026-11-16
- Tesla FSD fleet tops 7 billion city miles, adding ~500M in under four weeks — XFreeze · 2026-11-16
- Ropedia Releases Xperience 2: 1,500+ Scanned Real-World Scenes Paired With Egocentric Demos — liuziwei7 · 2026-11-16
- Hangzhou's Manycore Tech launches Aholo MS07 3D laser scanner with CHCNAV — teortaxesTex · 2026-11-16