Optimal Settings for Qwen3.6-27B Coding
starkruzr · reddit · 2026-07-18
The poster is discussing the most effective combinations of harnesses, server parameters, and system prompts when using Qwen3.6-27B for coding tasks.
They first shared their llama-server presets used on a machine with 2×16GB GPUs, detailing various pairings of quantization, MTP, KV cache, and context lengths. They summarized a few key findings:
- q80 KV provides roughly 1.5× more context than f16 KV with minimal quality loss.
- MTP (draft spec-decode) speeds up generation but sacrifices some context length.
- A 32GB VRAM setup can essentially only load a single 27B model at a time, and switching models incurs a few seconds of reload overhead.
The core question is: given these hardware constraints, how are others configuring their harnesses, system prompts, and inference settings to make this model act as a reliable coder?
More from coding & agent
- Cognition's SWE-2 uses a KKT duality argument in RL to shift the effort Pareto curve — YouJiacheng · 2026-09-11
- First-ever Three.js Conference lands in Paris, with a panel on AI-shortened design workflows — OdinLovis · 2026-09-11
- Data engineering, not agent frameworks, is the real bottleneck for enterprise AI agents — dhruv2038 · 2026-09-11
- RTK Terminal Compression Cuts Tokens but Leaves Your AI Coding Bill Unchanged — Bartaseth · 2026-09-11
- GPT-6 Astra beats Factorio with enemies in 44 in-game hours at ~$4,500 API cost — liminal_bardo · 2026-09-11
- Investment Analyst Asks How to Build a Claude-Based Diligence Agent Stack — Careless_Tie2286 · 2026-09-11