LangChain SF meetup to compare decision model Jev vs LLM judges for agent evals
LangChain · x · 2026-10-27
LangChain and TypeSafe AI host a November 5 meetup in San Francisco on decision models and agent evaluation.
Talks: Sydney Runkle on pairing cheap decision models (Jev) with frontier LLMs — "cheap by default, frontier on exception"; Allie Laabs on framing Jev as a "System One Model"; Seán Roche replaying identical Deep Agents runs through LangSmith against Jev, GPT-5.6 Luna, GPT-5.6 Terra, and Claude Sonnet 4.6, comparing accuracy, consistency, latency, and cost as a third path for agent evals beyond code-based checks and LLM judges.
More from coding & agent
- Hook everything into the Dot: a workaround to stretch ChatGPT subscription limits — teortaxesTex · 2026-10-27
- Jev launches people-search API for agents at $0.0089/lead, claiming 85% cheaper than Clay — alexcovo_eth · 2026-10-27
- Going through every compound engineering skill to decide where humans stay in the loop — kieranklaassen · 2026-10-27
- UCSB CS Prof. Xifeng Wang lands 3 grants worth $180K+ for practical agentic AI research — xwang_lk · 2026-10-27
- Gen games don't need to be realtime — turn-based interactivity works, devs argue — djcows · 2026-10-27
- Player rebuilds Street Fighter II in HD with Claude: $3,000 of tokens, 3 weeks — Fantastic-Jeweler781 · 2026-10-27