Qwen 3.6 27B agent gets much smarter after KV cache quantization change
Jordanthecomeback · reddit · 2026-07-28
A Reddit user reports a large quality jump after changing a local Qwen 3.6 27B agent’s quantization settings, especially the KV cache.
They were troubleshooting a slow Apple-silicon setup and moved from the standard iq4NL quant to a q4M heretic build, while also following Claude’s advice to use Q8 KV cache. The agent became noticeably better at tool use, recall, and following the system prompt, with roughly the same runtime but a similar memory footprint. The poster suspects that less aggressive quantization at either the model or KV level would help even more.
More from coding & agent
- MindGraph turns shared agent memory into a governed organizational brain — ShanRizvi · 2026-07-28
- Using K3 with Codex Desktop was a “big mistake,” says developer — HamelHusain · 2026-07-28
- Local dual-agent setup catches an AI trying to swap SQLite for Postgres — PrajwalTomar_ · 2026-07-28
- Microsoft Research: LLMs Fail to Track Evolving User Intent in Multi-Turn Conversations — alan_ritter · 2026-07-28
- Stop Building Everything: Why AI Startups Should Focus on Component-Level Breakouts — zeeg · 2026-07-28
- Kimi K3 tokenizer optimization cuts first-token latency by about 325 ms — philipkiely · 2026-07-28