Local 27B model replaced his coding API: a Qwen workflow and cost breakdown
Training-Respect8066 · reddit · 2026-09-24
A Redditor details running a local Qwen coding model (27B) instead of a paid API:
- Usage pattern: the model thinks a lot, so the trick is to let it run unsupervised; it can complete complex refactors with good decisions on its own.
- Setup: Q4KS quant with Q80 context quantization; Swift-Qwen is faster but loops more often. He uses the Pi agent without MCP, keeping only bash plus read/write/edit tools — the edit tool is the weak link, causing indentation-related retries. Docker serves as sandbox, and the agent runs on a Raspberry Pi.
- Cost: about 2.4 cents per 1M input tokens and 70 cents per 1M output tokens on his hardware, comparable to the cheapest providers on nano-gpt.com.
More from coding & agent
- Open-source multi-agent framework JiuwenSwarm hits 6.5k stars, targets 100-turn team alignment — ahuja_priyank · 2026-09-24
- Wire an eval gate into GitHub Actions so prompt regressions die before merge — bgoncalves · 2026-09-24
- Opus 5.5 at 'low' reasoning effort matches 'max' on task completion at 12x lower cost — daniel_mac8 · 2026-09-24
- Multi-agent workflow stalling? Check permissions and handoffs before blaming the model — Al_Grigor · 2026-09-24
- Code graph fusing static analysis and OpenTelemetry traces helps Sonnet beat Opus at debugging — Acceptable-Buyer-389 · 2026-09-24
- GitHub ships new maintainer controls for agentic coding, keynote slides open-sourced — marlene_zw · 2026-09-24