Jetson-PI: Boosting Onboard VLA Control Frequency to 6Hz, 8.6x Faster
机器之心 · wechat · 2026-07-25
Peking University, AIRS, and PrimeBot Research introduced Jetson-PI, a real-time Vision-Language-Action (VLA) control scheme for low-power edge devices. Through asynchronous inference, model scheduling, and engine optimization, it boosts control frequency on Jetson Orin from 0.7Hz to 6.06Hz without losing accuracy.
- Foresight-Aligned Asynchronous Correction: Instead of predicting future images, it trains a lightweight module (1% of parameters) to predict future environment representations, solving the perception-execution misalignment in asynchronous inference.
- Confidence-based Scheduling: Enables the robot to decide when to act on existing knowledge and when to re-invoke the VLM for fresh observations, reducing unnecessary compute.
- Engine Optimization: Developed Jetson-PI-Edge based on llama.cpp, leveraging CUDA graph reuse, persistent GPU caching, and flow matching unfolding to minimize overhead.
In real-world clothes folding tasks, this approach significantly reduced motion stalls and misalignment, pushing VLA control toward industrial deployment.
More from Embodied
- NVIDIA releases MotionBricks: real-time humanoid motion generation at 15,000 FPS with 2ms latency — _akhaliq · 2026-10-26
- Claude Code finds root backdoor in Honda Civic head unit, then debloats it — IndraVahan · 2026-10-26
- Temple health wearable opens pre-orders, users ask: why wear it before benefits are proven — abhishekcode42 · 2026-10-26
- FLASH: GPU-native deformable sim learns cloth folding in minutes on one RTX 5090 — ChongZzZhang · 2026-10-26
- Luke Wroblewski spots it: iPhone Duo's corner radius mirrors the original iPhone — LukeW · 2026-10-26
- Humanoids shattered forecasts: half-marathon record in 2026, 100m faster than Bolt — ben_j_todd · 2026-10-26