Microsoft Research’s SkillOpt tunes skills in text and hits 52/52 on benchmarks
eyishazyer · x · 2026-07-24
A long post breaks down Microsoft Research’s SkillOpt, a method that optimizes a natural-language “skill document” instead of model weights.
- The model stays frozen; the text instruction itself is what gets iteratively improved.
- The loop has four main parts: rollout on tasks, reflection by a separate optimizer model, bounded text edits as a kind of learning rate, and validation on held-out tasks.
- Failed edits are stored in a rejection buffer, and slower epoch-level updates help long-horizon skills evolve without blowing up context size.
- The author says SkillOpt went 52/52 across six benchmarks and seven target models, with especially large gains on tool-heavy workloads like SpreadsheetBench and OfficeQA.
- The practical appeal is that the final artifact is just a short Markdown file you can drop into the system prompt, with no extra inference-time calls.
Related event: Microsoft's SkillOpt Optimizes Agent Skills Without Tweaking Weights(5 posts)→
More from coding & agent
- Cognition's SWE-2 uses a KKT duality argument in RL to shift the effort Pareto curve — YouJiacheng · 2026-09-11
- First-ever Three.js Conference lands in Paris, with a panel on AI-shortened design workflows — OdinLovis · 2026-09-11
- Data engineering, not agent frameworks, is the real bottleneck for enterprise AI agents — dhruv2038 · 2026-09-11
- RTK Terminal Compression Cuts Tokens but Leaves Your AI Coding Bill Unchanged — Bartaseth · 2026-09-11
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- Investment Analyst Asks How to Build a Claude-Based Diligence Agent Stack — Careless_Tie2286 · 2026-09-11