Improved Qwen3.8-Flash chat template cuts answer tokens 40-61% with terse mode
returnity · reddit · 2026-10-17
A Reddit user open-sourced an improved chat template repo for Qwen3.8-Flash-Next (built on Unsloth's GGUF template), fixing multiple rendering bugs: inline effort tags like <|thinklow|>, JSON-string tool arguments no longer killing requests, no empty <think></think> replay, stray </think> split out, and graceful handling of max/minimal/none efforts. Normal history renders byte-identical to Unsloth's so KV cache is reused.
The new optional "Sharp" terse mode ports 27B's terseness block, toggled via a terse kwarg for easy A/B on one server. Benchmarks (UD-Q5KXL on llama.cpp, temp 1.0): thinking-on answers -40% tokens and -28% wall time; thinking-off -61% tokens and -60% time. The author notes terse slightly reduces accuracy and personally uses medium effort instead.
More from coding & agent
- Dev proposes shared cloud-local filesystem to unify agent bot/code/work workflows — sytelus · 2026-10-17
- AI didn't replace developers — it replaced our understanding of our own code — loveolya · 2026-10-17
- Reddit user pairs Mac mini M5 Pro with old M4 as sub-agent for local coding agents — Calm-Set6265 · 2026-10-17
- Go team adds interactive refactoring to gopls, proposes new LSP standard for multi-step dialogs — rseroter · 2026-10-17
- research-rag: local CPU-only PDF/ebook search with browser, CLI and MCP access — kishkisan · 2026-10-17
- Single-video 3D reconstruction via agent→MCP→Blender simulates industrial hazards — RexDouglass · 2026-10-17