Cheap-first routing: only 4 of 143 questions escalated to a frontier model, cost down 80%

xrplincoln · reddit · 2026-11-16

Instead of sending every request to a frontier model, the author routed per-question: a cheap model (DeepSeek V4.1 Flash, $0.07/M output tokens) answers first, a small checker model scores the answer 0–100 on correctness, instruction-following, and hallucination, and only answers below 75 escalate to a frontier model (Claude Opus 5.5).

Results across 143 questions (104 everyday, 39 stress tests), with costs from actual API token counts:

The checker escalated 4 questions — three real catches (a wrong count, blank answers on 40-digit multiplication and a hard Sudoku) and one false alarm. In a separate test it caught all 8 deliberately wrong answers.

The weak spot is the checker itself, the only barrier between a bad cheap answer and the user. The project exposes an OpenAI-compatible endpoint, so existing apps only need a base-URL change. Code: github.com/robd-hub/cheap-first.

Original post →

More from coding & agent

coding & agent channel →