llama.cpp adds decision models via /v1/systemone, returning option probabilities in a single forward pass

ggerganov announced decision model support in the latest llama.cpp builds, exposed through a new /v1/systemone endpoint: given a state (text, JSON, or screenshot) and typed questions, the model returns per-option probabilities in a single forward pass instead of generating tokens that must be parsed. The feature has drawn wide attention in the community.

Confirmed

Why it matters

2026-10-02 ~ 2026-10-03 · 8 related posts

Primary sources

4 near-duplicate retellings: ggerganov · ggerganov · adnan_hashmi · kalyan_kpl