LangSmith Tuned Evaluators Launch: Cuts Costs by 82%
hwchase17 · x · 2026-08-19
LangChain has launched LangSmith Tuned Evaluators, starting with Perceived Error. These evaluators run on production traces to catch undesirable agent behavior and provide feedback for improvement. Benchmarks show the tuned model beats frontier models at 82% lower cost. The key insight is making specialized evaluators cheap enough for continuous production use.
More from coding & agent
- atuin v18.24 adds cross-device sync to resume AI threads across Claude and Codex — braelyn_ai · 2026-10-16
- Agents turn conservative as context grows: edits shrink from 150 to 30 lines — dbreunig · 2026-10-16
- ai& becomes an official built-in Cline provider with 13 open-weight models — DavidBennett__ · 2026-10-16
- Open-source rizin-mcp lets LLMs run local binary and malware analysis via Rizin — Pure_Emergency1424 · 2026-10-16
- x402 as a free GTM channel: agents discover 100+ tools, no API keys needed — 0xJeff · 2026-10-16
- Sam Altman: stop getting better at prompts, build loops and graphs that prompt for you — goyalshaliniuk · 2026-10-16