Video Prompts as Robot Programs: S1 Follows 4 Recipes in One Kitchen
deepakpathak · x · 2026-09-09
CMU professor Deepak Pathak demonstrated the "physical prompt steerability" of his robot system S1: an .mp4 is now an .exe for a robot.
- In the same kitchen, feeding S1 four different video prompts induced four distinct behaviors
- One task was clearly out-of-distribution: putting a plate into a toaster
- The takeaway: video itself can serve as the robot's program — swap the video, swap the skill, no retraining needed
Related event: CMU's S1 Robot Executes Video Prompts Like Physical .exe Files(2 posts)→
More from Embodied
- Robot arms opened to the internet: the best and worst of remote teleoperation — Lumpy_Week7304 · 2026-09-09
- Robotics class hands out 12 pre-built SO-101 arms so students jump straight to calibration — YuXiang_IRVL · 2026-09-09
- IFA Berlin Has Record Number of Humanoid Robots as Consumer Tech Giants Embrace Them — VraserX · 2026-09-09
- Synaptrix demos non-invasive brain-computer interface Atlas: full cursor control from EEG, no implants — burny_tech · 2026-09-09
- Science Robotics study: motion tracking model trained on 100M+ frames enables natural humanoid whole-body movement — zhengyiluo · 2026-09-09
- Musk endorses 350-mile FSD challenge drive to Starbase ahead of Starship Flight 14 — elonmusk · 2026-09-09