Swapping RAG ranking for Jev lifted recruiter match precision from 44% to 92%
Select_Condition2805 · reddit · 2026-11-21
A dev running a recruiter Slack bot for an outsourcing firm replaced Bedrock Knowledge Base RAG ranking with Jev (TypeSafe AI), which scores each engineer's full notes/résumé for brief-fit probability, with a generative LLM only writing one-line explanations.
Evaluated with Ragas on 7 client requests and 111 engineers:
- shortlisted engineers confirmed as good matches: 44% → 92%
- cost per search: still 1-3 cents
Why not just feed all candidates to a generative LLM? 111 candidates total 200-310K tokens, nearing context limits (1,000 won't fit any model), and one frontier-model call per candidate costs 30-400x more.
More from coding & agent
- Multi-turn agentic RL on one TPU lifts Gemma 4 E2B from 9.4% to 95% win rate — Saboo_Shubham_ · 2026-11-21
- StepFun unveils Step 5 Preview at SF event focused on agent reliability and cost — StepFun_ai · 2026-11-21
- AI-made "game in a week" hype draws fire: it's a rough demo, not a game — AIandDesign · 2026-11-21
- What a Per-Agent Audit Trail Needs to Capture—and Where It Goes Incomplete — BlitzBallBruiser · 2026-11-21
- uivoid turns any API into a hosted, authenticated MCP server with zero code — Necessary_Client_114 · 2026-11-21
- Your personal agent can badger airlines over every past delay until they pay up — nickbaumann_ · 2026-11-21