Spatial-Interactor teaches VLMs spatial reasoning through physical interaction
arankomatsuzaki · x · 2026-09-27
Researchers introduce Spatial-Interactor, a framework training VLMs to learn spatial reasoning and build spatial memory through interaction with the physical world, like an infant. Current spatial training focuses on static Q&A, giving little direct supervision for state transitions; interaction trajectories naturally link observation-action-observation pairs for direct supervision. Learning is organized into a three-level curriculum: passive world-state transitions, active self-state transitions, and long-horizon trajectories. The team also releases the LSI-108K dataset built from simulated and real interaction trajectories. Paper and code are public.
More from Embodied
- Developer's New Robotics BLDC Controller PCB Batch Arrives, Running Unit Tests — wavefnx · 2026-11-16
- YC-backed Ornadyne's flapping-wing drone was classified as a bird by Air Force detectors — import_jmr · 2026-11-16
- Uber starts offering Amazon's Zoox robotaxi rides in Las Vegas — Polymarket · 2026-11-16
- Ant Lingbo Embodied AI Challenge crowns TARS team after 48-hour real-robot hackathon — 新智元 · 2026-11-16
- Tesla FSD fleet tops 7 billion city miles, adding ~500M in under four weeks — XFreeze · 2026-11-16
- Ropedia Releases Xperience 2: 1,500+ Scanned Real-World Scenes Paired With Egocentric Demos — liuziwei7 · 2026-11-16