Perplexity-built web app lets you draw music with webcam pinch gestures, mapped to pitch and loop timing
jeffgrimes9 · x · 2026-11-21
Perplexity built a webcam music-drawing web app inspired by @measureplan.
- Stack: MediaPipe/WASM hand tracking in a web worker, with multi-frame pinch detection and live smoothing.
- Mapping: each scribble's height sets a quantized pitch, its horizontal position sets loop timing, driving any of four Web Audio instruments.
A neat CV-plus-Web-Audio demo showing how far in-browser gesture interaction can go.
Related event: Perplexity Launches Scribble Music, a Camera-Based Gesture Music App(2 posts)→
More from Apps
- Venice AI launches Minds: no-code agents with a marketplace paying creators 90% of markup — mark_k · 2026-11-21
- AI assistant Dot finds a repair guy, negotiates the price and books an appointment — VraserX · 2026-11-21
- Superwall bundles free unlimited product analytics, targeting Amplitude/Mixpanel/PostHog users — JordanMorgan10 · 2026-11-21
- Google AI Overviews remains the biggest AI search surface — and it rides on Google rankings — lilyraynyc · 2026-11-21
- JooVoice's handoff: agent transfers the call to you for PIN checks, then takes over — kimmonismus · 2026-11-21
- JooVoice lets Grok, Muse and other agents make calls in 80+ languages to 67 countries — kimmonismus · 2026-11-21