NVIDIA's VoLo lands at CoRL 2026: a VLM agent that orchestrates robots through long-horizon tasks
erwincoumans · x · 2026-09-08
VoLo, a CoRL 2026 paper from NVIDIA and University of Michigan, frames open-vocabulary long-horizon manipulation as "physical orchestration": a VLM agent with memory plans, monitors, detects failures, recovers, and steers heterogeneous capabilities (VLA/WAMs, SAM3, grasp/place primitives) as interruptible tools—crucially without pausing the physical world.
- Introduces RoboVoLo, a high-fidelity simulation benchmark with 126 tasks spanning common sense, memory/state tracking, complex references, and world knowledge, with failure-mode diagnostics.
- Work led by Siyi Chen during an NVIDIA internship; project page, arXiv paper, and code are public.
More from Embodied
- Humanoid walking is continuous correction — watch recovery, not locomotion, in demos — Olivier__OG · 2026-10-26
- CircuitHub unveils The Grid, a factory-scale robot making PCBs in the US twice as fast as Shenzhen — garrytan · 2026-10-26
- AI researchers guessed robots wouldn't outrun humans until 2034 — it already happened — ben_j_todd · 2026-10-26
- Shanghai AI Lab-led team releases 100-hour egocentric wearable dataset for humanoid training — ChuckDBrooks · 2026-10-26
- RealSense D585 Pro AI-Powered 3D Stereo Depth Camera Unboxed for Physical AI — chrismatthieu · 2026-10-26
- Physical world agent swarm demo shared on X — pduan · 2026-10-26