OmniEcho: Spatial Audio Benchmark and Model for Embodied Agents
PKU-VaLuE-Lab · hf · 2026-09-25
PKU-VaLuE-Lab introduces OmniEchoBench and the OmniEcho model for spatial audio understanding in embodied agents.
- Benchmark: 6 tasks over 197 real-world spatial audio-visual scenes, 2,972 QA pairs, and 900 navigation samples with first-order ambisonics (FOA) audio from 30 real environments
- Pipeline: A controllable spatial audio rendering pipeline preserves geometric consistency among sound sources, visuals, and agent trajectories
- Model: OmniEcho adds an FOA spatial encoder to a pretrained semantic audio pathway, achieving SOTA on spatial audio-visual perception; sound-guided navigation approaches traditional vision-language navigation
- Open challenges: fine-grained spatial localization and distance estimation remain difficult
More from Embodied
- "No humanoid robot is being built by humanoids" — Matthew Chang's paradox — MatthewChang · 2026-11-11
- Unitree's hardware-only bet debated: control R&D, wait for software to catch up — teortaxesTex · 2026-11-11
- OpenTac: JHU/MIT open-source flex-PCB tactile skins that sensorize any robot surface — _krishna_murthy · 2026-11-11
- Chinese team open-sources a 15B-parameter humanoid robot foundation model — lmoroney · 2026-11-11
- Dyna Robotics' Taku performs long-horizon whole-body manipulation zero-shot, no on-site training — JasonMa2020 · 2026-11-11
- Humanoid robot hits roller skates in Matt Wolfe's latest AI news roundup — Matt Wolfe · 2026-11-11