Open-source AlphaVision-Bridge gives desktop companions real-time screen and webcam vision via Gemini
Training-Wait3789 · reddit · 2026-10-08
A developer released AlphaVision-Bridge, an open-source tool connecting the MateEngine desktop companion to Google's Gemini multimodal vision API and SillyTavern for continuous perception.
- Runs a local capture loop: grabs active desktop screen context and ingests webcam frames in real time
- Streams inputs over Python + WebSockets to Gemini vision endpoints for low latency, letting the on-screen companion react dynamically to what you're doing, playing, or working on
- Replaces manual screenshot pasting or plain text chat
The repo is on GitHub; the author is seeking feedback on the frame processing loop, prompt timing, and autonomous event handling ideas.
More from Apps
- Dev open-sources Game Summoner, a multi-agent pipeline that turns prompts into playable games — demonicpigg · 2026-10-09
- ChatGPT audited 14k transactions in an hour, fixing 700 budget categories — nickbaumann_ · 2026-10-09
- AI Agent Creates Explainer Videos for All 722 OpenAI Math Preprints, 93 Hours Total — jeffgrimes9 · 2026-10-09
- 3 engineers, $1M and 1.5T tokens: Compound V2 rebuilds Office suite for AI agents — peterjliu · 2026-10-09
- Building a synth baroque suite generator with Claude: 'another piece, maestro' and it composes — guillermosan · 2026-10-09
- Grok Bot Spots and Cancels Forgotten Meetings While Rivals Muse and Dot Stay Silent — elonmusk · 2026-10-09