Turning hand-drawn scribbles into multi-instrument music with RF-DETR hand tracking

teropa · x · 2026-11-17

@measureplan shares part 2 of "scribbling with sound": an instrument that turns hand-drawn scribbles into sound (y-axis pitch, x-axis time), now with multiple instruments. Built with JavaScript, Web Audio API, and Roboflow RF-DETR keypoint tracking for hand movements.

Original post →

More from Fun

Fun channel →