Logit-based decision models batch naturally: routing, scoring, yes/no in one forward pass
LysandreJik · x · 2026-10-12
Lysandre notes a key advantage of the logit approach: many decisions can be batched into a single forward pass — routing, scoring, yes/no questions, and more. It also works with VLMs, which is what makes the microducks demo possible.
More from coding & agent
- LightOn ships 2B code-search agent ColGrep with model, GGUF and paper — IgorCarron · 2026-10-12
- LightOn's 2B search agent matches 27B open-source models on adapted SWE-bench evals — IgorCarron · 2026-10-12
- ColGrep-Agent cuts per-question tool calls from 7.1 to 4.0 by searching locally — IgorCarron · 2026-10-12
- ColGrep-Agent cuts Claude Code API tokens 34.3% and cost from 7.3¢ to 4.4¢ per question — IgorCarron · 2026-10-12
- Benchmarking Claude Code search tools: grep vs ColGrep on 52 code-search tasks — IgorCarron · 2026-10-12
- ColGrep-Agent: a local search loop in three commands, 5.5s per query on H100 — IgorCarron · 2026-10-12