Vercel's agent-desktop lets Claude Code drive native Mac apps via the accessibility tree

Arindam_1729 · x · 2026-11-19

Developer Arindam published a video showing Claude Code controlling his Mac using Vercel's agent-desktop — no screenshots, no synthetic mouse. It reads native apps through the macOS accessibility tree, so Claude can actually click and type inside apps like Calculator, Finder and Clock.

The video covers setup from scratch, live demos, what broke, and the honest limits. Chris Tate is also promoting Vercel's Agent Desktop as "an Agent Browser for your whole computer" — the native-desktop-agent approach is gaining traction.

Related event: Vercel Open-Sources agent-desktop, Letting Claude Control Native Mac Apps(2 posts)→

Original post →

More from coding & agent

coding & agent channel →