Microsoft Open-Sources Skill Recorder: Generate AI Workflows by Recording Your Screen
udmrzn · x · 2026-08-03
Microsoft has open-sourced Skill Recorder, a desktop app that takes a new approach to building AI automations: showing the AI what to do rather than telling it.
- How it works: Users perform a task once while the app records screen actions, window switches, web pages, clipboard content, terminal commands, and voice explanations. GitHub Copilot CLI then translates this into a reusable SKILL.md containing the intent and ordered steps.
- Beyond traditional RPA: Instead of replaying brittle mouse coordinates, it attempts to convert web interactions into stable API, CLI, or native agent tool calls.
- Compatibility: Natively supports Microsoft Scout and Microsoft 365 Copilot Cowork. While not directly supporting Claude Code or Codex yet, the generated skill files can be manually adapted.
More from coding & agent
- Vercel Engineer Shares AI Agent Workflow: Fewer Meetings, Burst-Mode Work — brandon_galang · 2026-08-03
- GPT-5.6 Autonomously Hacks Robot Vacuum Firmware to Fix Maps — mariofilhoml · 2026-08-03
- Hands-On AI Agent Experience: Build Your Own Harness to Gain Real Edge — EXM7777 · 2026-08-03
- Pitfalls of Multi-Agent Content Workflows: Which Parts Should Never Be Agentic? — Typical-Baker9262 · 2026-08-03
- SafeAI: Open-Source Static Scanner for AI Agent Security Risks Pre-Deployment — IkarusCareer · 2026-08-03
- Top Open-Source and Closed-Source Computer-Use AI Agents in 2026 — TheTuringPost · 2026-08-03