Tessl: Jev is 13.6x faster and 2.7x cheaper than GPT Luna 6 as an LLM code verifier
aheineike · x · 2026-09-24
Tessl benchmarked TypeSafe's new decision model Jev as a drop-in replacement for the LLM "verifiers" (linting with reasoning) it runs on production code, comparing against its current judge GPT Luna 6:
- Scope: 6 projects, 2,725 verifier-file pairs, gateway cache bypassed so every call was a fresh generation
- Jev: $0.65 / 32s vs GPT Luna 6's $1.74 / 436.5s — 13.6x faster, 2.7x cheaper ($0.24 vs $0.64 per 1,000 targets)
- Against the previous Luna 5.6, Jev was 6.6x cheaper and 10x faster; Luna 6 got cheaper but slower, narrowing Jev's cost edge
- Methodology, model details, and commands are published so you can rerun it on your own repo
A practical pattern worth stealing: use a small decision model for large-scale code review instead of a flagship LLM.
Related event: Jev Beats GPT Luna as Code Verifier, 13.6x Faster(2 posts)→
More from coding & agent
- lattedit launches free local-first browser LaTeX editor with MCP support for coding agents — cneuralnetwork · 2026-11-11
- Rivet launches SQLite Forking: 20ms agent-thread forks with zero data copying — samgoodwin89 · 2026-11-11
- YouArt Desktop launches: AI agent edits video in CapCut, DaVinci and Premiere from client feedback — mhdfaran · 2026-11-11
- Boubou: one-command local voice AI that serves your phone and robots over Wi-Fi — LuozhuZhang · 2026-11-11
- Python 3.15 makes AttributeError actionable: suggests .append for .push mix-ups — KhuyenTran16 · 2026-11-11
- sentence-transformers maintainer releases new embedding pooling training method, code & checkpoints — tomaarsen · 2026-11-11