Rosply: Screen-Aware Desktop AI Agent

Feisty-Gas9764 · reddit · 2026-07-12

Rosply is an AI agent that watches your screen and takes over the mouse and keyboard: it takes a screenshot, sends the image to a vision model to generate a list of actions, and then automatically clicks, types, scrolls, and drags to complete desktop tasks.

Because it doesn't rely on APIs, it can interact with any website or application already open on your computer. Use cases mentioned by the author include: browsing and organizing information, reading files for summaries, and completing full coding projects in VS Code. It also supports voice commands and can be integrated as an MCP server for Claude Code, triggering PC automation directly from coding sessions. The author notes this is an independently developed and maintained product, which just secured its first sale two weeks after launch.

Original post →

More from coding & agent

coding & agent channel →