Anthropic open-sources claude-api eval skills with cost and eval hillclimb guides
RLanceMartin · x · 2026-09-30
Anthropic's RLanceMartin responded to feedback from Hamel Husain, saying he will update the skill accordingly, and shared the repo link: the skills/claude-api/shared/evals directory in the anthropics/skills repository.
The directory contains several eval-related docs:
- build-eval.md: how to build evals
- eval-audit.md: eval auditing
- eval-hillclimb.md: eval hillclimbing
- cost-hillclimb.md: cost hillclimbing
The repo itself is highly popular (179k stars, 21.2k forks) and is Anthropic's official skills collection.
More from coding & agent
- Baseten's Guide: Evaluate Open Models for Coding Agents on Your Own PRs — baseten · 2026-11-16
- Google Research open-sources PaperOrchestra, a multi-agent framework for writing AI papers — google-research · 2026-11-16
- ffmpeg-skill gives coding agents local video editing via 42 FFmpeg tools and MCP — kajisho5 · 2026-11-16
- Agents Now Reply to Slack Messages on Their Own, Resolving a Prod Incident Ghost-to-Ghost — iamrobotbear · 2026-11-16
- Engineer's Interview Prep Method: Use Claude to Find Which Answers Undersell Your AI Work — brandon_galang · 2026-11-16
- DeepSeek open-sources its app frontend "chat-demo", already at 3.9k stars — NielsRogge · 2026-11-16