Microsoft Research’s SkillOpt tunes skills in text and hits 52/52 on benchmarks
eyishazyer · x · 2026-07-24
A long post breaks down Microsoft Research’s SkillOpt, a method that optimizes a natural-language “skill document” instead of model weights.
- The model stays frozen; the text instruction itself is what gets iteratively improved.
- The loop has four main parts: rollout on tasks, reflection by a separate optimizer model, bounded text edits as a kind of learning rate, and validation on held-out tasks.
- Failed edits are stored in a rejection buffer, and slower epoch-level updates help long-horizon skills evolve without blowing up context size.
- The author says SkillOpt went 52/52 across six benchmarks and seven target models, with especially large gains on tool-heavy workloads like SpreadsheetBench and OfficeQA.
- The practical appeal is that the final artifact is just a short Markdown file you can drop into the system prompt, with no extra inference-time calls.
Related event: Microsoft's SkillOpt Optimizes Agent Skills Without Tweaking Weights(5 posts)→
More from coding & agent
- Agent Field Kit launches $29 security runbooks for production AI agents — alvelda · 2026-10-27
- Cloudflare Durable Objects validated as top architecture for AI agent WebSocket servers — tristanbob · 2026-10-27
- GitHub Next's Chopin prototype explores real-time multiplayer agentic planning — max__drake · 2026-10-27
- Veynod: An Open-Source Shared Workspace Where AI Agents Collaborate Like a Team — TKOWNS · 2026-10-27
- TMLR paper: enforced thinking doesn't reliably make LLM agents disclose key info to users — SharonYixuanLi · 2026-10-27
- LLM-written Rust library bbtree verified: speed claims hold, memory savings reverse — lmoroney · 2026-10-27