Faster World Action Models for Robotics
open-gigaai · hf · 2026-07-16
This work presents improvements to the World Action Model (WAM) in robot policy learning. The original WAM explicitly generates future videos during inference, which aids action learning but incurs massive overhead, hindering real-time closed-loop control.
The authors propose GigaWorld-Policy-0.5, decoupling training and inference:
- Training Phase: Combines Action-Conditioned World Modeling with WAM training to tightly couple visual dynamics with action representations
- Inference Phase: Performs action decoding only, eliminating future video generation to reduce overhead
- Introduces Mixture-of-Transformers to separate visual dynamics modeling and action generation into specialized experts, boosting inference efficiency
- Employs an agent-based AutoResearch pipeline to automatically search training configurations, minimizing manual tuning
The authors report that this method achieves an action inference latency of 85ms on a local RTX 4090. Experiments and ablations demonstrate enhanced real-time robot control while retaining the training benefits of future visual dynamics.
More from Embodied
- Amazon and Google sold 600M+ smart speakers, so why no AGI-era successor? — julianlehr · 2026-09-11
- ECCV26 Oral: Flow Matching Enables Single-Stage Multi-View Point Cloud Registration — ducha_aiki · 2026-09-11
- Polish developers build iPhone app that detects nearby Meta smart glasses — Low-Honeydew6483 · 2026-09-11
- Ant's Afu health AI hits 150M users, unveils AI+hardware health alliance at Bund Summit — APPSO · 2026-09-11
- Johns Hopkins Launches Full-Stack Hands-on Robot Learning Class with SO-101 Arm Kits — _krishna_murthy · 2026-09-11
- SyncWorld: In-Context Robot World Model Simulates Unseen Views and Embodiments Zero-Shot — ChongZzZhang · 2026-09-11