WinMind: an MCP server that drives Windows agents via the accessibility tree, not screenshots
Efficient_Heron5978 · reddit · 2026-09-30
A developer released WinMind, a Windows MCP server for computer-use agents that skips the screenshot→vision model→coordinate-guessing loop. Instead it reads the Windows UI Automation accessibility tree (the same layer as Narrator/NVDA), returns a compact numbered tree the agent can reason over, and invokes native accessibility actions like uiact(ref=30).
Highlights:
- Interacts with windows even when occluded; no mouse movement; token-efficient
- Ships 222 native Windows tools covering networking, security, virtual desktops, media, files, processes
- Author details hard-won edge cases: blank Chromium apps when covered (Discord, Spotify, VS Code, Steam), WinUI 3 + WebView2 self-loops (especially WhatsApp), clicks landing on handler-less inner elements, and finding windows by process name when titles differ
Early-stage, repo on GitHub, feedback wanted.
More from coding & agent
- AgentCraft: StarCraft rebuilt in the browser as an arena for AI agents — philipvollet · 2026-09-30
- Developer says AI agents did $100K worth of human labor in under a day — RileyRalmuto · 2026-09-30
- The model is the brain, the harness gives it hands: advantage shifts to what you build around it — Olivier__OG · 2026-09-30
- alphaXiv ships OpenResearch desktop app to turn coding agents into research agents — gekobraa · 2026-09-30
- Open-source 'gradient descent for agent memory' tool goes viral on X — Saboo_Shubham_ · 2026-09-30
- awesome-llm-apps repo tops 140k stars with 100+ free open-source AI agent templates — Saboo_Shubham_ · 2026-09-30