Set max_tokens to 1 and Read Logprobs: Turn Any Hosted LLM Into a Classifier
keep_up_sharma · reddit · 2026-09-24
A developer shares a trick to get Jev-style (even multimodal) decisions out of any hosted LLM provider without a new model: set maxtokens: 1, request logprobs from the API, and read the model's real probability over the option ids you provide. This works across multiple LLM providers and cuts both latency and cost for many tasks. An open-source (MIT) web demo is available at decidr-ts.
More from coding & agent
- 30 lines of JavaScript, no image models: pure-code generative art demo — nc_frey · 2026-09-24
- Developer calls Claude Opus 5.5 'a doof' at database tasks — rickasaurus · 2026-09-24
- TRACES: A New Benchmark That Grades AI Problem-Solving Process, Not Just Correct Answers — dr_cintas · 2026-09-24
- Dev reverse-engineers Qwen Image 2.1 PE, ships ComfyUI node that auto-computes dimensions — BleynSpecnaz · 2026-09-24
- Cua Releases Cua-S1-4B, First Multimodal Decision Model RL-Trained on Live Computer-Use Tasks — multimodalart · 2026-09-24
- Applied Compute uses Jev to auto-cluster failure modes in RL training traces — rhythmrg · 2026-09-24