Vercel's agent-desktop lets Claude Code drive native Mac apps via the accessibility tree
Arindam_1729 · x · 2026-11-19
Developer Arindam published a video showing Claude Code controlling his Mac using Vercel's agent-desktop — no screenshots, no synthetic mouse. It reads native apps through the macOS accessibility tree, so Claude can actually click and type inside apps like Calculator, Finder and Clock.
The video covers setup from scratch, live demos, what broke, and the honest limits. Chris Tate is also promoting Vercel's Agent Desktop as "an Agent Browser for your whole computer" — the native-desktop-agent approach is gaining traction.
Related event: Vercel Open-Sources agent-desktop, Letting Claude Control Native Mac Apps(2 posts)→
More from coding & agent
- Building agents is easy, scaling them for thousands of customers is where the real work hides — Franc0Fernand0 · 2026-11-19
- Deepnote rebuilds data apps: build with Codex or Claude, host in Deepnote — alex_verem · 2026-11-19
- NDepend open-sources a C# MCP Server with a complete tutorial and 35-minute video — adnan_hashmi · 2026-11-19
- Creator Studio ships with in-app assistants, MCP support, and open Keynote format — jasonwuishere · 2026-11-19
- Anthropic publishes free 33-page guide on turning repetitive prompts into reusable Claude Skills — aftahi_ai · 2026-11-19
- Dev open-sources finance MCP server with OAuth 2.1, PKCE and plan-based tool gating — Noahowshhh · 2026-11-19