Jev Lands in ChainForge as LLM Judge, Matching Sonnet 5 Accuracy at Fraction of Cost
IanArawjo · x · 2026-09-19
Developer Ian Arawjo announced that Jev is now available as an LLM judge in ChainForge. On the same benchmark dataset, Jev matches the accuracy of judges based on Sonnet 5 and GPT-5.4 mini at a fraction of the cost and with faster speed. A live example is available for anyone to inspect and try.
More from coding & agent
- AI agent books a United flight change on its own as 'do it for me' bar rises — armand_ruiz · 2026-09-19
- Clinical agent run costs $0.0047: 99 calls, 143K tokens with Jev in a triage workflow — MaziyarPanahi · 2026-09-19
- Alchemy IaC adds secret manager support for Doppler, Infisical and more — samgoodwin89 · 2026-09-19
- Swarms to ship MCP Deployer in v16, turning any agent into an MCP server in 5 lines — KyeGomezB · 2026-09-19
- Letting agents deploy your app then browse it like real users: super high-level fuzzing — lucasmeijer · 2026-09-19
- Prompting rule: ban fallbacks so AI models can't cheat around core work — Daniel_Farinax · 2026-09-19