Build Live Camera Gestures with MediaPipe Hand Landmarker

sophiamyang · x · 2026-08-03

Developer Sophia Yang shared an open-source project named Finger Frame Effect. The project utilizes the MediaPipe Hand Landmarker model to track hands in real-time within the browser.

When users form an "L" shape with their index fingers and thumbs—like a camera framing gesture—the system detects the quadrilateral area formed by the four fingertips and applies a live effect inside it. Built purely on Canvas 2D and WASM/GPU, it requires no build step to run locally.

Related event: Developer Open-Sources Hand-Gesture Frame Effect; AI Generation Not Yet Real-Time(2 posts)→

Original post →

More from Apps

Apps channel →