AgentVLN: 3B VLM brain with skill library tops embodied navigation benchmarks
机器之心 · wechat · 2026-09-10
AgentVLN adopts a "VLM-as-Brain" design (accepted to ECCV 2026): a vision-language model handles task understanding and skill orchestration while modular skills handle mapping, obstacle avoidance and motion. It maps SLAM-computed 3D waypoints onto the camera image so the VLM picks paths visually, plus a self-correction mechanism and Query-Driven Perceptual CoT that actively queries depth sensing when uncertain.
Built on Qwen2.5-VL-3B, it runs in real time on Jetson edge devices, leads R2R-CE/RxR-CE benchmarks, and has been deployed on a quadruped and a humanoid robot.
More from Embodied
- NVIDIA releases Isaac Lab 3.0 with pluggable physics and rendering backends — zhengyiluo · 2026-10-27
- Chums: open-source Apple Watch app puts Claude Code and Codex on your wrist — brandon_galang · 2026-10-27
- Dev uses Grok bot to turn ESP into an iPhone accessory for syncing robot servos — Baconbrix · 2026-10-27
- NVIDIA releases MotionBricks: real-time humanoid motion generation at 15,000 FPS with 2ms latency — _akhaliq · 2026-10-26
- Claude Code finds root backdoor in Honda Civic head unit, then debloats it — IndraVahan · 2026-10-26
- Temple health wearable opens pre-orders, users ask: why wear it before benefits are proven — abhishekcode42 · 2026-10-26