llama.cpp ships /v1/systemone endpoint for local Jev-style decision models
mitsuhiko · x · 2026-10-03
ggerganov announced decision models are now available in llama.cpp: a new /v1/systemone endpoint in the latest builds enables Jev-style inference running locally, efficiently, and privately, with multiple open models supported and more coming. mitsuhiko responded positively but asked for model-type labeling and to rename the feature "classifiers" instead of "decision models."
More from coding & agent
- FT: US tech outages blamed on rush to fix bugs found by AI — nordicinst · 2026-11-19
- Claude Code overtakes Cursor and Copilot in job-post mentions ahead of Anthropic IPO — antgoldbloom · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS adds private CA support to Bedrock AgentCore Identity for connecting agents to self-hosted IdPs — AWS ML Blog · 2026-11-19
- Orchestrator's Cloud Agents graduate from beta to general availability — julianweisser · 2026-11-19
- Zero users, 33 pages shipped: dev crowdsources audit for AI-agent trust schema — TheHamzaShahbaz · 2026-11-19