Hermes adds local backend: run Unsloth UD-Q4 quants of DeepSeek-V4-Flash and Qwen3.8 one-click
danielhanchen · x · 2026-09-04
Unsloth GGUFs can now be run locally in one click via Hermes. Daniel Hanchen confirms Hermes has a new local backend with support for Unsloth UD-Q4KXL and UD-Q4KM quants of DeepSeek-V4-Flash, Qwen3.8-27B, 3.6-35B-A3B, and Qwen3.8-Flash-Next.
More from Infra
- Wall Street prepares futures contracts on Nvidia GPU rental prices as compute becomes a commodity — VraserX · 2026-09-04
- RTX 4060 Ti 16GB runs MiniMax video model locally: 768p in 3 minutes — aziib · 2026-09-04
- Agentic AI forecast to drive 9X enterprise traffic growth through 2035 vs 2.5X baseline — Beth_Kindig · 2026-09-04
- NSF establishes operations center to expand national AI research resource access — DavidJLockett · 2026-09-04
- MLX-Serve v26.9.1 Ships: One-Shot Qwen Flash Runs from a Single Screenshot — TheMoonMidas · 2026-09-04
- Dev says Cloudflare's Wrangler CLI is the most agent-friendly way to run cheap infra — dinasaur_404 · 2026-09-04