llama.cpp ships /v1/systemone endpoint for local Jev-style decision models
mitsuhiko · x · 2026-10-03
ggerganov announced decision models are now available in llama.cpp: a new /v1/systemone endpoint in the latest builds enables Jev-style inference running locally, efficiently, and privately, with multiple open models supported and more coming. mitsuhiko responded positively but asked for model-type labeling and to rename the feature "classifiers" instead of "decision models."
Related event: llama.cpp adds Decision Models: one forward pass scores options directly(8 posts)→
More from coding & agent
- AI code is cheap; undoing its confidently repeated mistakes is not — sujingshen · 2026-10-03
- Orchestrator v0.13.3 ships kanban-style management for multiple coding agents — julianweisser · 2026-10-03
- He let a computer-use agent run his Tinder: reading profiles and swiping right by checklist — cneuralnetwork · 2026-10-03
- Pavan Belagatti releases complete hands-on guide to the agentic software factory — Pavan_Belagatti · 2026-10-03
- Agent workloads move infra bottlenecks beyond model latency, engineer explains — AccBalanced · 2026-10-03
- Personal Agent Demos Are Stuck on Restaurant Bookings While Users Want Taxes and Invoices Handled — sujingshen · 2026-10-03