Microsoft Open-Sources Skill Recorder: Generate AI Workflows by Recording Your Screen
udmrzn · x · 2026-08-03
Microsoft has open-sourced Skill Recorder, a desktop app that takes a new approach to building AI automations: showing the AI what to do rather than telling it.
- How it works: Users perform a task once while the app records screen actions, window switches, web pages, clipboard content, terminal commands, and voice explanations. GitHub Copilot CLI then translates this into a reusable SKILL.md containing the intent and ordered steps.
- Beyond traditional RPA: Instead of replaying brittle mouse coordinates, it attempts to convert web interactions into stable API, CLI, or native agent tool calls.
- Compatibility: Natively supports Microsoft Scout and Microsoft 365 Copilot Cowork. While not directly supporting Claude Code or Codex yet, the generated skill files can be manually adapted.
Related event: Microsoft Open-Sources Skill Recorder for Automated Workflow Generation(2 posts)→
More from coding & agent
- ERP•AI launches headless SaaS with $0 seats that bills machines: $1 buys 4,000 record writes — rohanpaul_ai · 2026-10-16
- FDE-Gym benchmark shows huge gap on real AI delivery tasks: top model scores 0.563 — DeepLethe · 2026-10-16
- Vibe-coded dashboard leaked franchise financials before anyone logged in — shauntrennery · 2026-10-16
- Fintech HR built a sourcing agent on 60,000 past applicants — 30 qualified candidates in a month — G0NZ0BOY · 2026-10-16
- Orchestrating a 100-image portrait of humanity for aliens with ChatGPT, Argon and p5.brush — dx8xb · 2026-10-16
- 3x DGX Spark cluster runs GLM-5.3-Flash locally behind a proxy, 1.75M tokens/day at 119W — Teknium · 2026-10-16