NVIDIA open-sources SkillEvaluator to vet AI agent skills before deployment
anthara_ai · x · 2026-11-19
NVIDIA released SkillEvaluator, an open-source (Apache 2.0) framework for evaluating AI agent skills and plugins before integrating them into real workflows. Already at 2.7k GitHub stars, it runs quality gates, detects semantic overlap, generates synthetic evaluation datasets, and performs live agent evaluation comparing runs with and without a skill to measure its actual effect on task results. Ships with an arXiv paper (2608.20614), docs, and a developer livestream.
More from coding & agent
- FT: US tech outages blamed on rush to fix bugs found by AI — nordicinst · 2026-11-19
- Claude Code overtakes Cursor and Copilot in job-post mentions ahead of Anthropic IPO — antgoldbloom · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS adds private CA support to Bedrock AgentCore Identity for connecting agents to self-hosted IdPs — AWS ML Blog · 2026-11-19
- Orchestrator's Cloud Agents graduate from beta to general availability — julianweisser · 2026-11-19
- Zero users, 33 pages shipped: dev crowdsources audit for AI-agent trust schema — TheHamzaShahbaz · 2026-11-19