Music Maker: an air-played 24-instrument webcam instrument built with Claude in one long session

Sourcecode12 · reddit · 2026-11-21

The author built "Music Maker" with Claude in one long session: open a browser, turn on your webcam, pinch and pull to leave a string in mid-air, sweep a fingertip to play. It offers 24 instruments (guitar, harp, sitar, marimba, drums, etc.) with per-string scales, chord mode, a looper with six beat parts, follow-chords retuning, and export to MP4/MP3/stems — all in one HTML file with no build or backend. Tech: MediaPipe's 21-point hand landmarker runs locally; pluck detection uses a dead zone against jitter; all sound is synthesized live with Web Audio (Karplus-Strong for plucks) on a look-ahead scheduler. Cost: 31M tokens over 83 requests, 30M of them cheap cached re-reads. Needs desktop Chrome/Edge, decent light, hands 40-80cm from camera.

Related event: Developer builds gesture-played virtual instrument Music Maker with Claude(3 posts)→

Original post →

More from Multimodal

Multimodal channel →