Dev builds deskcrew with Claude Code: coding agents share your desktop, you keep the mouse

acus9345 · reddit · 2026-11-13

Inspired by agent-desktop, a developer built deskcrew (MIT, Rust) almost entirely with Claude Code: a CLI and MCP server that lets coding agents operate desktop apps in the background, each with its own drawn cursor, while your real mouse and keyboard stay yours.

Improvements over the original: when an app lacks an accessibility tree, the agent can screenshot a window and click by position; agents read a compact control list and batch many steps into one call; replies list only what changed to save tokens.

On his own benchmark (Claude Sonnet filling and submitting an order form, median of 3 runs): 17s, 50k tokens, $0.039 vs 73s, 760k tokens, $0.205 for the fastest correct alternative — though he wrote both the tool and the benchmark. Windows is the main platform; macOS is early, Linux works on X11 without cursors, Wayland unsupported.

Original post →

More from coding & agent

coding & agent channel →