LangChain ships an eval-engineering skill for coding agents in Codex and Claude Code
BraceSproul · x · 2026-07-23
LangChain says its new Eval Engineering Skill can help coding agents build evaluations from repository context and agent traces.
- The skill is available in the langchain-ai/langchain-skills repo.
- It is designed to be used inside Codex or Claude Code.
- The workflow starts by opening the target repository with the agent you want to evaluate, then using a prompt to create an eval task under evals/.
- The output includes a target run plus a review step to check whether the verifier actually measured the intended behavior.
- The quoted launch text says the skill inspects how the agent is structured and mines traces to automate eval engineering.
Related event: LangChain Launches Eval Engineering Skill for Coding Agents(6 posts)→
More from coding & agent
- IDA 9.5 ships Qualcomm Hexagon decompiler plus IDA MCP for AI-driven reverse engineering — OwariDa · 2026-10-27
- Redditor builds a Star Trek-style home AI: the model was easy, the audio plumbing wasn't — FF2183 · 2026-10-27
- For OSS apps, proofs of concept — not PRs to one repo — may be the core primitive — dbreunig · 2026-10-27
- Hook everything into the Dot: a workaround to stretch ChatGPT subscription limits — teortaxesTex · 2026-10-27
- Jev launches people-search API for agents at $0.0089/lead, claiming 85% cheaper than Clay — alexcovo_eth · 2026-10-27
- Going through every compound engineering skill to decide where humans stay in the loop — kieranklaassen · 2026-10-27