markuprx: an open-source MCP server that turns narrated screen captures into one issue per annotation
TitleNo1715 · reddit · 2026-09-04
The author open-sourced markuprx, an MIT-licensed, fully local MCP server solving a real gap: agents see the repo but not your screen.
Key design: instead of handing the model one big recording blob, each modifier-key circle gesture while you narrate becomes its own issue (MX-001) with a cropped frame and the matching narration slice — circle three problems, get three independently actionable issues.
Pipeline: native macOS capture → local Whisper → heuristic pass to find moments you're describing something → ffmpeg frame extraction → timestamp-aligned structured Markdown. No Electron; cloud transcription only with your own key (screen recordings may capture sensitive content). Config is one npx --package markuprx markuprx-mcp entry; six tools cover screenshots, voice capture, video analysis, and recording.
Honest limitations: narration-to-mark alignment is heuristic (rambling after circling can mis-attach words), and pixel-pinned findings break on layout shifts — stable selectors/text anchors suggested but not built yet.
More from coding & agent
- AI made code cheap, not engineering: why judgment matters more than ever — _jaydeepkarale · 2026-09-04
- Open-source control plane routes AI coding agents by task risk and context budget — kisuke4922 · 2026-09-04
- xAI to Host Grok Bot Galaxy: Three-Day Event Teaching Users to Build Custom AI Agents — Kyrannio · 2026-09-04
- Garry Tan: His Personal AGI Is a Folder of Markdown Files, Shipping 400x His 2013 Output — garrytan · 2026-09-04
- Hivemind launches persistent memory infra for agents: unlimited context, shared swarm mind — Kyrannio · 2026-09-04
- Hamel Husain: Don't Build AI Products If You Won't Inspect Your Data — hugobowne · 2026-09-04