agent-desktop: open-source tool lets AI agents E2E test desktop apps via accessibility tree
talkaboutdesign · x · 2026-10-31
Developer @mdlahfir released agent-desktop, an open-source tool giving AI agents computer-use capabilities focused on desktop app E2E testing: it reads apps via the accessibility tree, drills into parts of a window to save tokens, and can run multiple agents on one app at once. Works on macOS, Windows, and Linux. Install with npm i -g agent-desktop.
Related event: Vercel Labs Open-Sources agent-desktop for Full Desktop AI Control(2 posts)→
More from coding & agent
- recurse: a fully local open-source agent harness that gives models a wait tool instead of sleep loops — anshulkundaje · 2026-10-31
- Dev hails Capy as the best agent interface yet, blending whimsy and utility — noahsolomon · 2026-10-31
- Open-source MCP server Professor Clippy lets agents reach you via desktop sticky notes and phone — geetbatth · 2026-10-31
- Running 12 agents on one RTX 3090 lifts total throughput from 30 to 110 tok/s — Mchanger · 2026-10-31
- One prompt: Claude builds a 2,616-line disassemblable robot octopus in three.js — jnack · 2026-10-31
- dotey ships DeepSeek Harness plugin so Claude Design runs on DeepSeek with comment-based iteration — dotey · 2026-10-31