2,000+ navigation tasks across 133 environments test how far LLMs are from zero-shot robot control
PaulYacoubian · x · 2026-09-29
Researchers gave Jev and other models a robot body and benchmarked them against Dimcode, Astra, Fable, Opus and 5.6 on 2,000+ navigation tasks across 133 real and simulated environments, covering navigation, spatial reasoning and world geometry.
Graded on speed, cost, tokens, collision count and path quality, the study asks how far language models are from zero-shotting complex real-time control tasks. The full dataset, code and paper are open source.
More from Embodied
- YC-backed Ornadyne's flapping-wing drone was classified as a bird by Air Force detectors — import_jmr · 2026-11-16
- Uber starts offering Amazon's Zoox robotaxi rides in Las Vegas — Polymarket · 2026-11-16
- Ant Lingbo Embodied AI Challenge crowns TARS team after 48-hour real-robot hackathon — 新智元 · 2026-11-16
- Tesla FSD fleet tops 7 billion city miles, adding ~500M in under four weeks — XFreeze · 2026-11-16
- Ropedia Releases Xperience 2: 1,500+ Scanned Real-World Scenes Paired With Egocentric Demos — liuziwei7 · 2026-11-16
- Hangzhou's Manycore Tech launches Aholo MS07 3D laser scanner with CHCNAV — teortaxesTex · 2026-11-16