Adding Motion Sense to VLAs With Frozen SAM 2 Lets Robots Catch Moving Bottles
nikhilaravi · x · 2026-10-08
Position alone isn't enough for dynamic robotic tasks. By using a frozen SAM 2 video model to distill recent frames into a compact motion cue (speed and direction) for a VLA, researchers enabled the robot to actually catch a moving bottle. SAM 2 is open-sourced.
More from Embodied
- Jeff Ladish: AI will echo the Industrial Revolution acceleration, the dispute is just timescales — JeffLadish · 2026-10-08
- Researchers compile a larval fish brain into a simulated circuit running 26x faster than spiking models — mtizard · 2026-10-08
- US Treasury issues first outbound investment fine: $200k over $92k Chinese robotics AI deal — pstAsiatech · 2026-10-08
- Palmer Luckey: I Believe in Humanoid Robots, But Won't Build Them Myself — PeterDiamandis · 2026-10-08
- Autonomous Trash-Picking Quadruped: Extended Arm Links and a Crouch Trick to Fix Reachability — IsaiahBallah · 2026-10-08
- Microduck robot emotion design open-sourced: 14 emotions pairing motion keyframes with sounds — alexcovo_eth · 2026-10-08