Built with Claude: an instrument you play in thin air via webcam gestures
Sourcecode12 · reddit · 2026-11-21
A developer built Music Maker with Claude over one long session: open the page, turn on your webcam, pinch with both hands and pull apart to stretch a string in the air, then sweep a fingertip to pluck it. Each string can be assigned one of 24 instruments (guitar, sitar, marimba, 808 bass, etc.) and a scale, with pitch bending, sustains, layered loop recording, six pre-made beats, a follow-chords mode, and export to MP4/MP3/WAV plus stems — loops can even be imported into Suno for restyling.
The engineering is notable: MediaPipe hand tracking runs fully in-browser (21 landmarks per hand, camera feed never leaves the machine); plucks are detected as fingertip crossings with a dead zone against jitter; all sound is synthesized live via the Web Audio API (Karplus-Strong for plucked strings, no samples); beats run on a look-ahead scheduler tied to the audio clock. Everything ships as one HTML file with no build step, backend, or account. Cost: 31M tokens across 83 requests, of which 30M were discounted cached re-reads.
Related event: Developer builds gesture-played virtual instrument Music Maker with Claude(3 posts)→
More from Apps
- Founder says Squad agents have fully taken over his Gmail inbox with follow-ups and pings — tibo_maker · 2026-11-21
- Viral prompt turns ChatGPT or Claude into a money-opportunity research desk with a 7-day launch plan — ifioknkem · 2026-11-21
- ElevenLabs launches Captions in its mobile app for auto-styled video subtitles — aitrendz_xyz · 2026-11-21
- Grok Bot template turns one idea into a coded animated video with music — nima_owji · 2026-11-21
- Browser instrument you play by pinching strings in midair, built with Claude — HashemGhaili · 2026-11-21
- Aftergrid OS: offline AI plus medical and survival library on a single USB stick — realmeetjames · 2026-11-21