UIUC & CMU's LUCID: Teaching Robots Manipulation Skills from Human Videos
lukas_m_ziegler · x · 2026-08-09
UIUC and CMU introduced LUCID, a system that learns dexterous manipulation skills from unstructured human videos. It is embodiment-agnostic, meaning it can work across different robot bodies without retraining.
Notably, the researchers published the actual failure modes instead of hiding them:
- Stirring: Hand and pot occlude the spoon, causing tracking loss and revealing perception gaps.
- Wiping: The towel drops mid-motion and the hand presses into the table, making it unrecoverable.
- Binning: Grasp slips due to insufficient force control for objects with different properties.
- Cable routing: The dexterous hand gets stuck and fails to grasp the cable, showing some tasks remain highly difficult.
More from Embodied
- VLA-Δ: Zhejiang University Adds Physical State Transition Supervision to VLA Models — OmniAI-ZJU · 2026-10-16
- PINT: Shared Predictive Intent Tokens Unify Reasoning, World Modeling, and Robot Actions — Xinyu Guo · 2026-10-16
- TouchScale releases 500 hours of unified egocentric vision-tactile data for scaling study — jiqizhixin · 2026-10-16
- Ghost raises $11M for Core, a personal AI computer that runs locally in your home — nick_linck · 2026-10-16
- Robot shows up at Costco to fetch the famous $1.50 hotdog — majidmanzarpour · 2026-10-16
- 15 Leju Kuavo humanoid robots run 2 months at Hangzhou auto-parts line, 98% success rate — CyberRobooo · 2026-10-16