LangSmith ships Jev-as-a-judge to score every production trace cheaply
airesearch12 · x · 2026-09-22
LangChain launched Jev-as-a-judge in LangSmith: score every production trace instead of a sample, check more criteria per trace without rising costs, and catch safety or security issues fast enough to trigger automated responses. Harrison Chase says it scores traces cheaply and accurately. Jev is a zero-shot classifier with frontier-ish intelligence.
Related event: LangSmith Launches Jev-as-a-judge for Cheap Full-Trace Evaluation(2 posts)→
More from coding & agent
- Boubou: open-source CLI turns your laptop into a fully local voice AI hub — alexcovo_eth · 2026-11-12
- User automates entire video clipping workflow with Nous Research's Hermes agent — Teknium · 2026-11-12
- As models improve, writing good evals gets harder and more important — amankhan · 2026-11-12
- Prime agent ships with day-one multi-agent communication, runs in Minecraft unmodified — sarahcat21 · 2026-11-12
- Autonomous agent edits just 1,024 weights to lift Qwen3.5 0.8B from 7.4% to 37.4% on MATH-500 — VictorSanh · 2026-11-12
- Omarchy 4.6 lets you share local AI models across your tailnet, says DHH — alexcovo_eth · 2026-11-12