Turn any LLM into a decision model with ~15 lines of inference-only code

helloiamleonie · x · 2026-11-06

Core implementation, fully inference-only: take any LLM (LFM3-1.7B in the demo), attach one-token option codes (A/B/C) per option, run a single forward pass without generating text, read the next-token logits, keep only the option-code scores, and softmax into per-option probabilities. Full transformers + torch code included.

Original post →

Turn any LLM into a decision model with ~15 lines of inference-only code

More from coding & agent