MiniCPM-Robot Enables Fully Local Robot Inference: Offline Tracking at 33Hz
HeyToha · x · 2026-07-25
The author points out that most current robot demos are fragile, relying heavily on stable Wi-Fi and cloud compute, which causes them to fail under weak networks or long tasks. The newly released MiniCPM-Robot series addresses this by combining contextual memory with fully local tracking.
The release includes three core components:
- MiniCPM-RobotTrack: Achieves fully offline target tracking on the Unitree Go2 Edu robot dog with 180ms end-to-end latency (5+ Hz). It continues making decisions even when physically disconnected from the internet.
- MiniCPM-RobotManip: A 1.5B VLA (Vision-Language-Action) model that utilizes historical visual context during multi-step tasks (e.g., remembering button presses, moved objects, or resuming after occlusion) without exploding inference costs.
- PhyAI Open-Source Framework: An inference infrastructure for Physical AI that uses CUDA Graph optimization and custom Triton kernels to boost inference rates from 10 Hz to 33 Hz or even 36 Hz.
Additionally, the model uses visual-token compression to cut visual processing computation by about 50% while remaining competitive with Qwen-VLA and π0.5, effectively reducing hardware costs and power draw.
Related event: OpenBMB Open-Sources MiniCPM-Robot for Offline Embodied AI(10 posts)→
More from Embodied
- Inside Ant Group's play at WAIC-style expo: AI and hardware vendors settle into new division of labor — 智东西 · 2026-09-11
- Amazon and Google sold 600M+ smart speakers, so why no AGI-era successor? — julianlehr · 2026-09-11
- ECCV26 Oral: Flow Matching Enables Single-Stage Multi-View Point Cloud Registration — ducha_aiki · 2026-09-11
- Polish developers build iPhone app that detects nearby Meta smart glasses — Low-Honeydew6483 · 2026-09-11
- Ant's Afu health AI hits 150M users, unveils AI+hardware health alliance at Bund Summit — APPSO · 2026-09-11
- Johns Hopkins Launches Full-Stack Hands-on Robot Learning Class with SO-101 Arm Kits — _krishna_murthy · 2026-09-11