μDPad turns a smartwatch's optical HR sensor into a microgesture detector, no cameras needed

cholz · x · 2026-10-06

μDPad repurposes a smartwatch's multi-channel optical HR sensor as a spatial imaging sensor: 8 photodiodes around the wrist capture spatially varying tissue deformation as fingers move. Combined with the watch's IMU motion, a hidden Markov model decodes events with valid gesture transitions for continuous input—no cameras or finger-worn sensors required. To be presented at ACM ICMI.

Related event: μDPad Turns Smartwatch Heart Sensors into Gesture Imagers(3 posts)→

Original post →

More from Embodied

Embodied channel →