AR glasses turn hand and voice gestures into robot navigation, winning open source prize
GregCook2011 · x · 2026-09-05
Developer JohannesTscharn won 1st place in the open source track of LensList with an AR interface for robot navigation. Using only hands or voice, users issue move-to commands and a Unitree robot dog (stock firmware) autonomously navigates there.
- DimensionalOS powers the full navigation stack with dynamic pathing and LiDAR streaming
- UI and interactions run on Specs AR glasses
- v2.0 is in progress: VPS support (Multiset) to reduce drift beyond 5m and cleaner DimOS integration
Scobleizer reposted it as the first robot UI of its kind he'd seen, imagining controlling robots via AR glasses five years from now.
More from Embodied
- Stanford's T2-z lets robots probe hidden physics with a poke, lifting success from 34% to 73% — stanfordnlp · 2026-10-21
- Snap Hires Robert Downey Jr. as Chief Customer Experience Officer to Sell Specs AR Glasses Against Meta — adariostrange · 2026-10-21
- Fei-Fei Li team unveils FACT, a force-aware foundation model for robot dexterity — stanfordnlp · 2026-10-21
- Upcoming paper claims big models can handle latency-critical real-time robotics — ManlingLi_ · 2026-10-21
- New project at the intersection of agents, embodied AI, and games gets a nod — ZeeshanZiaML · 2026-10-21
- NVIDIA open-sources Flora, a robotics data engine 125x cheaper than GPT-6 Astra — DrJimFan · 2026-10-21