Running Qwen 27B locally via MCP + Docker sandbox to refactor shell scripts

ag789 · reddit · 2026-10-27

A Reddit user details using a locally-run Qwen 27B model, connected through a custom MCP server and Docker sandbox, to refactor a complex shell script for llama.cpp. The model caught subtle details unprompted (filtering config vars not meant for llama-server) and accurately verified manual edits hunk-by-hunk from a unified diff. Main complaints: very slow inference and rapidly exhausting the 65,535 context budget in long sessions. Full verification dialogue and linked GitHub projects included.

Original post →

More from coding & agent

coding & agent channel →