safeagents judge bench v2 leaderboard: Cloudflare clef-flash tops at 0.893
yb2698 · x · 2026-11-10
Updated leaderboard for safeagents judge bench v2 (661 real agent tool calls, ranked by balanced accuracy):
- Cloudflare clef-flash: 0.893 (false-block rate 0.192, p50 latency 0.326s)
- Cloudflare clef-omni: 0.877
- vllm-sr d3-mini: 0.856 (recall 1.0, false-block 0.288)
- LiquidAI d1-3B: 0.836, almost never blocks legit calls (0.8% false-block rate), p50 latency 0.035s
The benchmark scores small decision models acting as agent safety judges.
Related event: safeagents judge bench v2 launches leaderboard on Hugging Face(3 posts)→
More from coding & agent
- YC F26's 0.security Launches Autonomous Security Team That Ships Fixes, Claims 30+ Linux 0-Days — ycombinator · 2026-11-11
- DSPy 3.5 released: framework is now 85% smaller and production-ready — dbreunig · 2026-11-11
- A Swarm of 10 DeepSeek Agents With an Intercom Turns Out Extremely Effective at Finding Exploits — andersonbcdefg · 2026-11-11
- DIY AI neon sign: LILYGO display + Hermes Agent + LFM3-Audio voice terminal — alexcovo_eth · 2026-11-11
- Vercel Security Review flags 57,897 vulnerabilities in first week, agent auto-patches 14,665 — cramforce · 2026-11-11
- RLVR lets small models close the coding gap; Python's dynamic typing hurts pretraining — mdancho84 · 2026-11-11