Hermes adds local backend for one-click Unsloth GGUF models

Unsloth's danielhanchen announced Hermes now has a local backend enabling one-click local runs of Unsloth GGUF-quantized models such as DeepSeek-V4-Flash, using UD-Q4KXL and UD-Q4KM formats.

2026-09-04 ~ 2026-09-05 · 2 related posts

• Hermes adds local backend: run Unsloth UD-Q4 quants of DeepSeek-V4-Flash and Qwen3.8 one-click — danielhanchen · 2026-09-04
• Hermes adds a local backend with Unsloth UD-Q4 quants for DeepSeek-V4-Flash and Qwen models — maximelabonne · 2026-09-05