Cornell's EchoMotion tracks full-body movement with just a smartwatch and ultrasound
rschu · x · 2026-11-17
Cornell's SciFi Lab, led by Cheng Zhang, unveiled EchoMotion, which tracks a person's entire body movement using only an off-the-shelf smartwatch.
- The system repurposes the watch's built-in speaker and microphone to emit ultrasonic waves, sensing body position sonar-style, decoded by a lightweight AI model.
- It's privacy-friendly (no cameras) and computationally efficient, requiring no custom hardware.
- Once integrated into wearables or VR systems, it could track workouts, daily activities, and physical rehabilitation progress.
Robert Scoble notes this solves a long-standing problem he cared about for VR body tracking.
Related event: Cornell's EchoMotion Tracks Full-Body Motion with a Smartwatch(2 posts)→
More from Embodied
- VR human demos fix persistent failures in point-cloud grasping policies — hcltech-robotics · 2026-11-17
- Ultrasound plus a smartwatch and a lightweight AI model enables full-body tracking — rschu · 2026-11-17
- DeepMind's Raia Hadsell on transferring skills between robots at RAAIS — nathanbenaich · 2026-11-17
- Ropedia-Xperience-2 dataset: 1,500+ 3D scene scans and 131 hours of egocentric video — liuziwei7 · 2026-11-17
- Niantic's Object Interaction Makes Gaussian Splat Scenes Editable and Physics-Ready — lukas_m_ziegler · 2026-11-17
- A 4.5M-parameter TTS model runs fully offline on an ESP32-S3 — ngxson · 2026-11-17