Testing the jev Judge: 8 Hallucinated Refund Timelines Found in 48 Sessions
strickvl tested the jev judge across 48 agent sessions, catching 8 hallucinated refund timelines, and demonstrated JSON-based configuration with jev assigning p(yes)=0.93 to timeline violations.
2026-09-24 ~ 2026-09-24 · 2 related posts
- Episode 1: Kitaru Integrates jev Judge to Cheaply Catch Agent Hallucinations(2026-09-24, 2 posts)
- Episode 2: Testing the jev Judge: 8 Hallucinated Refund Timelines Found in 48 Sessions(2026-09-24, 2 posts)
- JSON setup for jev judge surfaces 8 hallucinated refund sessions in 48 — strickvl · 2026-09-24
- 8 of 48 agent sessions had hallucinated refund timelines, caught by jev judge — strickvl · 2026-09-24