Faster World Action Models for Robotics
open-gigaai · hf · 2026-07-16
This work presents improvements to the World Action Model (WAM) in robot policy learning. The original WAM explicitly generates future videos during inference, which aids action learning but incurs massive overhead, hindering real-time closed-loop control.
The authors propose GigaWorld-Policy-0.5, decoupling training and inference:
- Training Phase: Combines Action-Conditioned World Modeling with WAM training to tightly couple visual dynamics with action representations
- Inference Phase: Performs action decoding only, eliminating future video generation to reduce overhead
- Introduces Mixture-of-Transformers to separate visual dynamics modeling and action generation into specialized experts, boosting inference efficiency
- Employs an agent-based AutoResearch pipeline to automatically search training configurations, minimizing manual tuning
The authors report that this method achieves an action inference latency of 85ms on a local RTX 4090. Experiments and ablations demonstrate enhanced real-time robot control while retaining the training benefits of future visual dynamics.
More from Embodied
- Johns Hopkins Launches Full-Stack Hands-on Robot Learning Class with SO-101 Arm Kits — _krishna_murthy · 2026-09-11
- SyncWorld: In-Context Robot World Model Simulates Unseen Views and Embodiments Zero-Shot — ChongZzZhang · 2026-09-11
- A 3D Pose Dataset for Dogs Released — ducha_aiki · 2026-09-11
- Swaayatt demos autonomous driving at 52 km/h on mountain roads, self-recovers after skid — sanjeevs_iitr · 2026-09-11
- AUAR's MicroFactory brings a deployable robotic wood-panel factory to the construction site — lukas_m_ziegler · 2026-09-11
- Musk: Cybercab certified at 165 Wh/mi, the most efficient production EV ever — elonmusk · 2026-09-11