skillEd: auditable agent evals via CLI and MCP, evidence over agent summaries
MiserableFlatworm337 · reddit · 2026-10-26
The author argues that when an agent invokes evaluations through MCP, the evidence should remain human-inspectable: case identity, grading results and saved reports easy to find, rather than trusting an agent's "tests passed" summary. CLI is useful for explicit reproduction commands, MCP for agents working through the same evaluation process — but neither makes a weak test stronger; the cases and grading criteria still determine what results mean. The post introduces skillEd, an evaluation CLI plus local MCP tooling for Codex, Claude Code and other agents that produces saved reports.
More from coding & agent
- A Claude Code prompt that strips ads and tracking off your Smart TV in 15 minutes — alex_verem · 2026-10-26
- Blogger says a Claude Code prompt can strip smart TV tracking and ads in 15 minutes — alex_verem · 2026-10-26
- SpaceX AI engineer turned missing context into skills: 1,000 PRs in a month — nikola_mr64990 · 2026-10-26
- Open-source sky camera run by Claude Code catches 17 meteors overnight, cuts star false alarms to 7% — Terrible_Award_2124 · 2026-10-26
- AI-built OpenSearch clone validated by 6,000 black-box tests: Rust at 64.5%, Go at 32.6% — Strong-Mousse-1020 · 2026-10-26
- Fully local open-weight pipeline produces 10-min animated episodes at ~4 GPU-hours each — Zangetsu__0 · 2026-10-26