Hand Gesture Synth: Building a Web Audio Instrument with MediaPipe

measure_plan · x · 2026-07-23

A developer built a hand-controlled synthesizer using JavaScript, Web Audio API, and MediaPipe. Moving the hand left and right plays different notes, while up-and-down movement controls the volume. Users can customize the synth sound and assign specific fingers to trigger a "pluck" effect. The source code is publicly available among the author's 30+ open-source projects.

Related event: Developer Creates Web-Based Gesture-Controlled Synthesizer(2 posts)→

Original post →

More from Apps

Apps channel →