Local Reasoning Configs: Managing Qwen's Thought Budget
Altruistic_Heat_9531 · reddit · 2026-08-18
The author shares llama.cpp configuration tips for running local models (specifically Qwen 3.8), focusing on controlling "reasoning effort" to balance performance and resource usage.
Key Strategies:
- Native Support: Models like Qwen 3.8 and DeepSeek V4 natively support effort levels (low, medium, high, xhigh).
- Token Budgeting: For models lacking native support (e.g., Qwen 3.5/3.6), a token budget is used to cap reasoning length.
- Hybrid Limits: Even with native levels, a hard max reasoning token cap is applied.
- Non-Preserving Mode: An xhigh-no-preserve variant uses reasoning as a scratchpad without saving it to history, saving context window space.
The author notes that low effort is sufficient for most use cases.
More from coding & agent
- Six-month prediction: hiring for generic agent harnesses built from scratch will cool — yi111 · 2026-10-16
- Omarchy ISO wouldn't boot on NVIDIA, so he had Claude patch it — indragie · 2026-10-16
- Dev uses Grok to clean up 3D printer firmware, catches it sneaking in nonsense code — yacineMTB · 2026-10-16
- A rude AI agent took 89% of a shared resource in 102-run multi-agent personality experiment — Brave-History-6502 · 2026-10-16
- Guardrails can make risky delegation work — but it takes a full-time team, says iandanforth — iandanforth · 2026-10-16
- What can you truly delegate? Only tasks with unambiguous, verifiable results — iandanforth · 2026-10-16