vLLM Team Open-Sources Decision 2.0 Decision Models from 0.6B to 27B

vLLM's Semantic Router team open-sourced Decision 2.0, a family of six decision models ranging from 0.6B to 27B parameters under Apache-2.0. Instead of generating answers, the models score options, evaluating 64 questions in a single forward pass in as fast as 63ms.

2026-10-03 ~ 2026-10-04 · 3 related posts