Real-Time Hand Gesture Control for AI Video Effects via MediaPipe and Gemini
mhdfaran · x · 2026-08-12
A developer showcased a highly creative video interaction project. The system uses MediaPipe for hand tracking to capture the area between the user's fingers, and employs Gemini's video editing capabilities to fill that area with AI-generated video content.
As the user moves their hands, the AI-generated video window moves with them in real time, enabling intuitive and dynamic special effects control.
Related event: Open Source Project Enables Gesture-Controlled AI Video Effects(2 posts)→
More from Fun
- Netizen Roasts Claude's Tone: It Acts Like You Live in an Apple Commercial — akbirthko · 2026-08-12
- The Evolution of AI Engineering: From Prompt to Graph Engineering — mattturck · 2026-08-12
- Fully AI-Generated 3D Physics Game Consumes 257M Tokens in One Prompt — RanaHanocka · 2026-08-12
- Minimax H3 Generates Video: A Stroll Through the 'Museum of Poop' — blackdatafilms · 2026-08-12
- Doing RL with LLMs is like rediscovering human nature from first principles — burny_tech · 2026-08-12
- Counter-intuitive AI Agent Behavior: Stop Extrapolating Human Thinking onto Agents — krishnan · 2026-08-12