Hermes adapter gets GGUF release: matches xhigh thinking at a quarter of the tokens
yb2698 · x · 2026-11-19
harness-hub released a GGUF build of the Qwen3.8-27B Hermes LoRA adapter for llama.cpp, trained with TRL AsyncGRPOTrainer plus custom RL envs, OpenEnv and safeagents. With thinking off, the adapter matches the base model at xhigh reasoning effort while generating 3.5–4.4× fewer tokens per task — a big win for local deployment. The GGUF file itself hasn't been re-evaluated through llama.cpp, and a quantized base would shift results further.
More from coding & agent
- Content Multiplier Grok bot listing shows 2-click setup for multi-platform content — VibeMarketer_ · 2026-11-19
- Grok bot trained on Dan Koe's system turns one idea into a week of content — VibeMarketer_ · 2026-11-19
- NousResearch Hermes adapter lifts Qwen3.8-27B non-thinking perf 14 points, cuts tokens 3.5-4.4x — yb2698 · 2026-11-19
- Matt Pocock unveils VECTOR method for adopting AI on any task, seeks early feedback — mattpocockuk · 2026-11-19
- Meta's MLE agents ran 1,097 experiments on production rankers with 29.6% acceptance rate — dair_ai · 2026-11-19
- 11 system security concepts every engineer should know, from OAuth to Zero Trust — goyalshaliniuk · 2026-11-19