Tuning Qwen3 27B as a coding agent on 2x3090s cuts turn latency from 28s to 7s
bolts98 · reddit · 2026-09-19
A Reddit user shares how they tuned Qwen3 27B with vLLM + Oh My Pi (OMP) as a coding agent on 2×RTX 3090s, cutting average wait per turn from 28s to 7s. Key changes:
- Explicit effort level on every role (unset ones defaulted to xhigh)
- thinkingtokenbudget of 7500
- maxTokens 8k → 32k (file writes were getting cut off)
- Tool output over 10KB redirected to a file
- Max 4 subagents, appendOnlyContext enabled
More from coding & agent
- Muse Hooks Into Plaid: Fully Automated Budgeting From Robinhood to Google Sheets — alexandr_wang · 2026-09-19
- Inco Splash hits 144 tok/s on Qwen3.8-27B M5 Max, 3x faster than Ollama — ResearchCrafty1804 · 2026-09-19
- Jev beats a Sonnet 5-powered retriever on accuracy at a fraction of the cost — IanArawjo · 2026-09-19
- 9 use cases for Jev-style System 1 models in real-time voice AI agents — TheMoonMidas · 2026-09-19
- Grok Bots support webhooks, letting you trigger them from any platform — mattyp · 2026-09-19
- macOS 27 ships with mlx_whisper built in, letting agents transcribe video locally — vista8 · 2026-09-19