Video Prompts as Robot Programs: S1 Follows 4 Recipes in One Kitchen
deepakpathak · x · 2026-09-09
CMU professor Deepak Pathak demonstrated the "physical prompt steerability" of his robot system S1: an .mp4 is now an .exe for a robot.
- In the same kitchen, feeding S1 four different video prompts induced four distinct behaviors
- One task was clearly out-of-distribution: putting a plate into a toaster
- The takeaway: video itself can serve as the robot's program — swap the video, swap the skill, no retraining needed
Related event: Skild's robot foundation model S1: one .mp4 is the robot's .exe(7 posts)→
More from Embodied
- CoRL paper: flow-matching VLAs can run 1-step Euler inference with no retraining — kaixhin · 2026-10-26
- Robotic dexterity should be judged on speed, force control and tool use, not copying humans — DJiafei · 2026-10-26
- Shenzhen company combines humanoid robots with industrial robot arms — RoboBalaji · 2026-10-26
- Realbotix, a sex-doll maker, unveils Echo humanoid with lifelike face — CyberRobooo · 2026-10-26
- Track bolt robot tightens railway fasteners in 6–7 seconds with sub-mm precision — RoboBalaji · 2026-10-26
- Tesla FSD (Supervised) Approved in Latvia, Its 10th European Country — XFreeze · 2026-10-26