The Smoothest Robot Rollout of 127 Episodes Still Failed: Motion Smoothness Metrics Measure Motion, Not Success
Scobleizer · x · 2026-09-13
Harpreet Sahota, Hacker-in-Residence at Voxel51, scored all 127 episodes of a cube-in-bowl task from RoboLab-EgoX on motion smoothness (SPARC, LDLJ, etc.) and found the 8th-smoothest rollout in the batch actually failed the task — zero flags, no anomalies.
Key takeaways:
- Smoothness metrics measure how the arm moved, not whether the cube landed in the bowl. A fluid path to the wrong place scores as flawless.
- Score for triage, not gates: smoothness tells you which episodes to review, never which ones passed.
- The article includes a reproducible workflow: picking a single task without downloading the full 21.8GB dataset, building the dataset and motion signals, scoring, and working around a 5.4-second episode.
More from Embodied
- What Schumacher's 'Small Is Beautiful' Teaches Us About Embodied AI — yongqianme · 2026-09-13
- XPeng's humanoid robot IRON leaves the assembly line, mass production targeted before end of 2026 — emmanuelvivier · 2026-09-13
- Mecka AI nears $500M valuation amid race for robot training motion data — emmanuelvivier · 2026-09-13
- freecad-mcp: 2.2k-star MCP server lets Claude Desktop drive FreeCAD for CAD and FEM — tom_doerr · 2026-09-13
- Robots roll out: AI patrol bots on Chinese streets, Sally teaching assistant in US schools — Scobleizer · 2026-09-13
- UBTECH scales humanoid production toward 10,000-unit capacity as U1 orders top 13k — CyberRobooo · 2026-09-13