chatllm.cpp adds support for Intern-Decision's parallel diffusion-style decisions

foldl-li · reddit · 2026-10-18

Developer foldl-li added support for the Intern-Decision model collection from the InternLM team to the local inference framework chatllm.cpp, with text-only support for now. The interesting twist: unlike H2O-Lightning and similar models that generate one answer per run, Intern-Decision fills all decision positions with "<decision>" marks in a single diffusion-style run, making decisions generally faster while maintaining solid performance.

Original post →

More from coding & agent

coding & agent channel →