Local Qwen Coding Agent on MacBook: Tackling Context & Output Bottlenecks
Techngro · reddit · 2026-08-08
The author shares severe bottlenecks encountered when using oMLX to run Qwen3.6-35B-A3B-4bit with the Pi coding agent to process a large TypeScript repository on a 32GB MacBook Air.
Core Problems:
- Insufficient Context: System, tool, and repository instruction overhead consumes 10.2K tokens. With a 19.5K context window limit, only 5K tokens of working room are left, frequently triggering auto-compaction and interrupting tasks.
- Output Limit: The 4K max output token limit is too tight for Qwen with thinking enabled, causing incomplete responses.
Optimization Ideas:
- Reduce system instruction overhead and lower post-compaction retained tokens (e.g., decrease keepRecentTokens from 4096 to 1024-2048).
- Disable or reduce thinking mode during tool-heavy repository investigation to save output budget.
- Use different profiles for different tasks (investigation vs. deep coding).
- Explore reliably expanding the effective context window on 32GB Apple Silicon.
More from coding & agent
- Demystifying RLMs: Building Recursive Agents with deepagents — LangChain · 2026-08-08
- New in Claude Code: Sessions Can Now Message Each Other — EricBuess · 2026-08-08
- Andrew Ng Was Right: Practical Multi-Agent Workflows with Claude Code — PrajwalTomar_ · 2026-08-08
- Agent Design Debate: Why Execution and Verification Must Be Separated — OGMYT · 2026-08-08
- LangChain founder highlights: What is an RLM harness? — hwchase17 · 2026-08-08
- Clarifying Agent dev: Context is a read, Memory is a write — hwchase17 · 2026-08-08