Claude Code Controls Native Mac Apps via Vercel's agent-desktop

Arindam_1729 · x · 2026-11-19

The author published a video showing Claude Code controlling macOS via Vercel's agent-desktop — no screenshots, no mouse simulation. It reads native apps through the accessibility tree, letting Claude actually click and type inside them.

Tested on Calculator, Finder, and Clock, the video covers setup from scratch, live demos, the part that broke, and an honest rundown of its limits.

Related event: Vercel Open-Sources agent-desktop, Letting Claude Control Native Mac Apps(2 posts)→

Original post →

More from coding & agent

coding & agent channel →