rasbt on harness vs model fine-tuning: Qwen3.8-27B hit 65% on SWE-bench Pro

rasbt · x · 2026-11-21

Sebastian Raschka joins a discussion on SWE-bench improvement paths. TheTuringPost cited HF's recipe of keeping the harness and adapting the model: Qwen3.8-27B went from 39% to 65% on SWE-bench Pro with RL plus one small LoRA. rasbt says he saw the post last week and was thinking about how much difference the harness makes and why fine-tuning for a harness matters — framing the real question as which side is cheaper to change for your setup.

Related event: Debate over whether LLMs can absorb agent harness as RL tuning pays off(3 posts)→

Original post →

More from coding & agent

coding & agent channel →