gazeCOM: Open-Source Gaze- and VLM-Driven Outpainting on Top of ComfyUI
grebenshyo · reddit · 2026-09-08
A Reddit developer shared gazeCOM, an open-source, locally-run app for interactive and agent-driven outpainting built on ComfyUI.
Generation is organized around spatial points: drivers supply inputs forming a saliency distribution whose weighted center of mass positions a 1024×1024 generation frame; results are pasted back onto the canvas, turning outpainting into a navigable process. Two driver types:
- Interactive/procedural drivers convert gaze tracking, hand gestures, cursor movement, camera CV, or autonomous roaming into spatial points accumulating into a live heatmap;
- Vision-model drivers let a local VLM (the author uses Gemma) inspect the image and return an operative canvas coordinate rather than just a description.
Other features: automatic iterative generation and compositing, expandable canvas, weighted mutable pools for prompts and ComfyUI workflows, per-prompt LLM enhancement, visual memory and decision history, automatic workflow discovery with local overrides. The author candidly notes limits — local Gemma doesn't reason well about artistic decisions, so results are underwhelming and development is paused — and shares exported settings from the demo video for reproducibility.
More from coding & agent
- Spotify cut Claude Code tokens 90% with a 350-line routing rule, not a model breakthrough — krishnan · 2026-09-08
- A developer proposes an informal agent-native mathlib, tentatively named mathgraph — Sauers_ · 2026-09-08
- Ix builds a persistent symbol graph of your codebase across 26 languages for humans and AI — tom_doerr · 2026-09-08
- Dev builds FreeBuff MCP to route ChatGPT tasks to free agent models — Swimming_Ask3859 · 2026-09-08
- GitHub now classifies agent policy blocks as 'skipped', not failures — Crescitaly · 2026-09-08
- Companion launches iMessage AI agent that reuses your ChatGPT account with MCP support — Scobleizer · 2026-09-08