Quartermaster 1.7 adds llama.cpp decision-model support with a probability playground
OneMoreName1 · reddit · 2026-10-14
Quartermaster, a local inference manager that swaps llama.cpp/image/audio/video models in and out of VRAM, released v1.7 with support for llama.cpp's new decision models (/v1/systemone):
- Decision GGUFs (Kev, OpenJev, Laya...) are auto-discovered and VRAM-sized like other models
- A Playground tab renders per-option probability bars for Choice/Score/true-false prompts
- A Decision tab finds models on Hugging Face
- POST /v1/systemone is proxied through the same scheduler and API keys
Requires llama.cpp b11361+.
More from Infra
- OpenJet claims Qwen3.8-27B coding runs 1.9x faster than llama.cpp on one RTX 3090 — JeremyCMorgan · 2026-10-23
- Jensen Huang lays out NVIDIA's full Vera Rubin agentic system: NVL72, MGX, CMX and RTX — rohanpaul_ai · 2026-10-23
- ONNX to Transformers.js: running models directly in your browser — JosephJacks_ · 2026-10-23
- MiniMax M3.1 Flash free for 3 days on 0G, with 1M context and 512K output — MiniMax_AI · 2026-10-23
- "We bet on Cloudflare and it paid off": R2 and D1 at billion scale — dinasaur_404 · 2026-10-23
- Public data is drying up; private training data is turning into a browsable catalog — SucceededMind · 2026-10-23