Turn Your Camera into an Instrument: Hand Gesture Controlled Synth

measure_plan · x · 2026-07-23

A developer built an interactive project using JavaScript, Web Audio API, and MediaPipe that turns a webcam into a musical instrument. Users can move their hands left-right to play notes and up-down to control volume, with customizable synth sounds and specific finger gestures to trigger a 'pluck' effect.

Original post →

More from Fun

Fun channel →