Why Robots Can't Learn from Video Alone: The Need for Action Data
chris_j_paxton · x · 2026-08-13
Commenting on a video showing human manipulation skills, Baoyu Li highlighted that robots cannot learn skills solely from video data.
Humans can quickly learn from videos because they already possess relevant "motion/skill primitives." Acquiring these underlying primitives requires actual action data, making visual input alone far from sufficient.
More from Embodied
- AutoAgent0: VLM-powered agentic runtime lifts long-tail driving success by 28.3pp — yining_hong · 2026-10-16
- CarryOn: dual-loop harness adds personalization and safe recovery to frozen VLA robots — Zixuan Wang · 2026-10-16
- FoveaVLA replaces wrist cameras with learned foveation, hitting 70.8% success — Haoyu_Xiong_ · 2026-10-16
- Musk teases two-way Grok x Optimus integration: Grok in the bot, bot in Grok — beffjezos · 2026-10-16
- SimVTA uses simulator-rendered video to post-train driving world action models with RL — OpenDriveLab · 2026-10-16
- Robotics data startups compared: Scale AI tops $1B revenue as 9 LLM vs robotics data suppliers benchmarked — FinanceYF5 · 2026-10-16