Skepticism on robot demos: Success rates and robustness unclear
binarybits · x · 2026-09-02
Raises critical technical questions regarding a robot demo video: What is the actual success rate? How many tasks failed? How sensitive is it to lighting or setting changes? How well does it handle unexpected events? It is difficult to gauge the true significance of the progress based solely on the published demo.
More from Embodied
- Robotics podcast RoboPapers hits 100 episodes, celebrates sim-to-real community growth — ruilong_li · 2026-09-03
- Unity researcher voxelized his living room into billions of millimeter-scale voxels, stunned Stanford VR audience — Scobleizer · 2026-09-03
- Meta's Muse Spark jumps 1.1 to 1.3 in 55 days, photo-to-3D simulation at $0.60 — alexandr_wang · 2026-09-03
- Counterfactual debugging scales sim2real failure diagnosis to 1M steps in world models — sarahcat21 · 2026-09-03
- Mila, Oxford, Cambridge, Tsinghua and 12 more institutions propose ComBodied Agents, a human-centric AI paradigm — jiqizhixin · 2026-09-03
- Agibot's CReF helps humanoids find safe footholds across rough terrain in real time — Scobleizer · 2026-09-03