MiniCPM-Robot Enables Fully Local Robot Inference: Offline Tracking at 33Hz
HeyToha · x · 2026-07-25
The author points out that most current robot demos are fragile, relying heavily on stable Wi-Fi and cloud compute, which causes them to fail under weak networks or long tasks. The newly released MiniCPM-Robot series addresses this by combining contextual memory with fully local tracking.
The release includes three core components:
- MiniCPM-RobotTrack: Achieves fully offline target tracking on the Unitree Go2 Edu robot dog with 180ms end-to-end latency (5+ Hz). It continues making decisions even when physically disconnected from the internet.
- MiniCPM-RobotManip: A 1.5B VLA (Vision-Language-Action) model that utilizes historical visual context during multi-step tasks (e.g., remembering button presses, moved objects, or resuming after occlusion) without exploding inference costs.
- PhyAI Open-Source Framework: An inference infrastructure for Physical AI that uses CUDA Graph optimization and custom Triton kernels to boost inference rates from 10 Hz to 33 Hz or even 36 Hz.
Additionally, the model uses visual-token compression to cut visual processing computation by about 50% while remaining competitive with Qwen-VLA and π0.5, effectively reducing hardware costs and power draw.
Related event: OpenBMB Open-Sources MiniCPM-Robot for Offline Embodied AI(10 posts)→
More from Embodied
- NVIDIA open-sources FLORA, a robotics data engine ~125x cheaper than GPT-6 Astra — nvidia · 2026-10-27
- Embodied AI startups need a different operational discipline, investor says — ___Mufasaa · 2026-10-27
- π0.5 study: raising demos from 10 to 438 lifts Place Ball in Bowl success from 7% to 83% — stingning · 2026-10-27
- GPT-6 Astra controls dexterous hands zero-shot at just 5.2% success in 500 trials — stingning · 2026-10-27
- HandsOn benchmark: 66 verified tasks and 18,000 human demos for dexterous manipulation — stingning · 2026-10-27
- DexPort: a handheld interface with a real robot hand for dexterous-hand data collection — pabbeel · 2026-10-27