llama.cpp Ships GGUF Collection of Decision Models: Clef, OpenJev, Laya Run Locally
ngxson · x · 2026-10-05
A llama.cpp maintainer reminds users that ggml-org's 'Decision models' GGUF collection on Hugging Face works natively with llama.cpp's /v1/systemone API—running fully locally.
Highlights: Clef 27B and Clef-Flash 9B (zero-shot classification), OpenJev 27B (image-text-to-text), Laya 0.4B text classification (5k+ downloads), plus tiny Julia-1 0.1B and Kev-4B models. All GGUF quantized, updated within days.
Related event: llama.cpp adds support for decision models like Clef and OpenJev(2 posts)→
More from Models
- X rebuilds real-time reply moderation guide around Grok, dropping Perspective API — tetsuoai · 2026-10-05
- Alleged Opus 5.5 Generates an Eerie Face Laughing and Crying at Once — repligate · 2026-10-05
- Yacine: Opus hallucinates more, but Astra straight-up lies to me — yacineMTB · 2026-10-05
- SFT revival paper slammed for missing eval setup: single-shot sampling may make scores meaningless — hyunw_kim · 2026-10-05
- Grok Bot defends no-roleplay design as users push for affectionate AI coworkers — repligate · 2026-10-05
- Gemini 4 Argon (High) tops Text Arena at 1525 pts, becomes top cost-efficient frontier model at $8/MToken — BLUECOW009 · 2026-10-05