Using Video Models for Robot Control
oier_mees · x · 2026-07-13
At RSS 2026, the author presented their latest work, Mimic-Video: Video-Action Models for Generalizable Robot Control Beyond VLAs.
The core question: What happens if a robot's policy is built on a pretrained video model rather than a static vision-language backbone?
They propose Video-Action Models (VAMs), leveraging rich temporal representations learned from large-scale video data to boost robot learning. The paper claims this approach yields better sample efficiency and training speeds compared to traditional Vision-Language-Action (VLA) models, while also benefiting from ongoing advancements in foundational video models.
The author also mentions they are in Sydney for RSS, presenting first at the Pioneers Workshop and then at the main conference, and welcomes offline chats about robot learning and foundation models.
Related event: Mimic-Video: Video-Action Robot Control Showcased at RSS 2026(2 posts)→
More from Embodied
- Chums: open-source Apple Watch app puts Claude Code and Codex on your wrist — brandon_galang · 2026-10-27
- Dev uses Grok bot to turn ESP into an iPhone accessory for syncing robot servos — Baconbrix · 2026-10-27
- NVIDIA releases MotionBricks: real-time humanoid motion generation at 15,000 FPS with 2ms latency — _akhaliq · 2026-10-26
- Claude Code finds root backdoor in Honda Civic head unit, then debloats it — IndraVahan · 2026-10-26
- Temple health wearable opens pre-orders, users ask: why wear it before benefits are proven — abhishekcode42 · 2026-10-26
- FLASH: GPU-native deformable sim learns cloth folding in minutes on one RTX 5090 — ChongZzZhang · 2026-10-26