Pi-Adapted Qwen3.8-27B Doubles Local Coding Pass Rate With 63% Fewer Tool Calls

yb2698 · x · 2026-11-19

Hugging Face adapted Qwen3.8-27B for the pi coding agent with RL and a LoRA: SWE-bench Pro (Hard 51) pass@1 jumped 29.4% → 62.7%, Terminal-Bench 2.1 39.5% → 55.8%, with 55–62% fewer tool calls; weights and methodology are open. User kesslerIO then ran the merged Q4KM quant locally on a 128 GB M5 Max MacBook Pro with Splash: 796 tok/s prefill and 119 tok/s decode at 19.5 GiB on a 32K prompt, completing 13/24 coding attempts vs 7/24 for base Q4 with 63% fewer tool calls (425 vs 1141). He notes paired reliability p=0.125, so general superiority isn't established.

Original post →

More from coding & agent

coding & agent channel →