Jetson-PI: Boosting Onboard VLA Control Frequency to 6Hz, 8.6x Faster
机器之心 · wechat · 2026-07-25
Peking University, AIRS, and PrimeBot Research introduced Jetson-PI, a real-time Vision-Language-Action (VLA) control scheme for low-power edge devices. Through asynchronous inference, model scheduling, and engine optimization, it boosts control frequency on Jetson Orin from 0.7Hz to 6.06Hz without losing accuracy.
- Foresight-Aligned Asynchronous Correction: Instead of predicting future images, it trains a lightweight module (1% of parameters) to predict future environment representations, solving the perception-execution misalignment in asynchronous inference.
- Confidence-based Scheduling: Enables the robot to decide when to act on existing knowledge and when to re-invoke the VLM for fresh observations, reducing unnecessary compute.
- Engine Optimization: Developed Jetson-PI-Edge based on llama.cpp, leveraging CUDA graph reuse, persistent GPU caching, and flow matching unfolding to minimize overhead.
In real-world clothes folding tasks, this approach significantly reduced motion stalls and misalignment, pushing VLA control toward industrial deployment.
More from Embodied
- Ant's Afu health AI hits 150M users, unveils AI+hardware health alliance at Bund Summit — APPSO · 2026-09-11
- Johns Hopkins Launches Full-Stack Hands-on Robot Learning Class with SO-101 Arm Kits — _krishna_murthy · 2026-09-11
- SyncWorld: In-Context Robot World Model Simulates Unseen Views and Embodiments Zero-Shot — ChongZzZhang · 2026-09-11
- A 3D Pose Dataset for Dogs Released — ducha_aiki · 2026-09-11
- Swaayatt demos autonomous driving at 52 km/h on mountain roads, self-recovers after skid — sanjeevs_iitr · 2026-09-11
- AUAR's MicroFactory brings a deployable robotic wood-panel factory to the construction site — lukas_m_ziegler · 2026-09-11