LangChain's Harrison Chase ships a skill for building agent evals iteratively
hwchase17 · x · 2026-08-25
LangChain founder Harrison Chase shares his thinking on the easiest way to create agent evals and announces a new skill to support this iterative process. The accompanying article, "How we Build Agent Environments & Tasks," is a practical guide to creating synthetic agent environments and tasks, resulting in a two-step pipeline that builds from traces, code, and/or human input first, then iterates.
More from coding & agent
- How OpenAI's Codex went from failed side project to 40M weekly users in under a year — danshipper · 2026-10-16
- Open Nshipyard cleans Canada's messy civic data, exposing $15.1B phantom spend, with MCP tools for agents — RichardsonDx · 2026-10-16
- Claude Opus 5.5 effort levels tested: low reasoning iterates 9x faster than max — tom_doerr · 2026-10-16
- Photon 2.0 lets AI agents reach users via WhatsApp, Telegram, SMS and voice in one click — techNmak · 2026-10-16
- Figma launches Guidelines and Code Sources so AI agents can follow your design system — JaynitMakwana · 2026-10-16
- Ex-DeepMind Eng Lead's AI Calling Agent Fo Cut Hang-Up Rate from 80% to 20-30% — julianweisser · 2026-10-16