Vercel open-sources agent-desktop: reliable computer use via accessibility trees, no pixel guessing
abhishek__AI · x · 2026-11-02
agent-desktop, an open-source project from vercel-labs, turns desktop interfaces into structured data so AI agents can reliably operate any app.
- No pixel matching — it reads real UI structure through OS accessibility trees
- Stable element references make actions safe to retry
- Works on macOS, Windows and Linux without stealing window focus
- Built in Rust, Apache-2.0 licensed, already at 7.9k GitHub stars
Related event: Vercel open-sources agent-desktop for reliable AI desktop control(4 posts)→
More from coding & agent
- Dev builds 3D universe explorer with 20 galaxies, 767 planets using Codex GPT-6.1 Sol — OpenAIDevs · 2026-11-02
- ChatGPT, Claude and Perplexity's fetchers don't run JavaScript, leaving client-rendered sites invisible to AI — gaganghotra_ · 2026-11-02
- SGLang boosts multimodal inference >10% by replacing GPU memory bookkeeping with a dict lookup — charles_irl · 2026-11-02
- kivi: hold Fn, talk, and it types polished text anywhere on your Mac — itsOmSarraf_ · 2026-11-02
- A base LLM plus 11 lines of code is all you need for a decision model — helloiamleonie · 2026-11-02
- Fix codebase structure before asking AI agents to write tests, says engineer — arpit_bhayani · 2026-11-02