llama.cpp adds Decision Models, expanding local inference capabilities

paf1138 · reddit · 2026-10-02

A Reddit post points to a new ggml-org blog entry: llama.cpp now supports "Decision Models."

Related event: llama.cpp adds decision models via /v1/systemone, returning option probabilities in a single forward pass(8 posts)→

Original post →

More from Infra

Infra channel →