Built with Claude: an instrument you play in thin air via webcam gestures

Sourcecode12 · reddit · 2026-11-21

A developer built Music Maker with Claude over one long session: open the page, turn on your webcam, pinch with both hands and pull apart to stretch a string in the air, then sweep a fingertip to pluck it. Each string can be assigned one of 24 instruments (guitar, sitar, marimba, 808 bass, etc.) and a scale, with pitch bending, sustains, layered loop recording, six pre-made beats, a follow-chords mode, and export to MP4/MP3/WAV plus stems — loops can even be imported into Suno for restyling.

The engineering is notable: MediaPipe hand tracking runs fully in-browser (21 landmarks per hand, camera feed never leaves the machine); plucks are detected as fingertip crossings with a dead zone against jitter; all sound is synthesized live via the Web Audio API (Karplus-Strong for plucked strings, no samples); beats run on a look-ahead scheduler tied to the audio clock. Everything ships as one HTML file with no build step, backend, or account. Cost: 31M tokens across 83 requests, of which 30M were discounted cached re-reads.

Related event: Developer builds gesture-played virtual instrument Music Maker with Claude(3 posts)→

Original post →

More from Apps

Apps channel →