One rank-96 LoRA boosts Qwen3.8-27B across 3 agent harnesses, 55.5% to 63.5% mean

HauntingMoment · reddit · 2026-11-20

A "super adapter" experiment for Qwen3.8-27B: LoRAs trained separately for three agent harnesses (Hermes Agent, OpenCode, pi) turned out nearly orthogonal (cosine similarity 0.01), so they were concatenated along the rank dimension into a single rank-96 LoRA—no lossy merging (no TIES/DARE).

Results (thinking on, xhigh):

The blog's core is a reusable recipe: train a harness adapter for your own model, harness, and tasks. Adapter released at harness-hub/Qwen3.8-27B-super-adapter; full experiments and open questions in the HF blog post.

Related event: yb2698 merges a week of LoRA adapters into one super-adapter, boosting Qwen coding scores by up to 20 points(9 posts)→

Original post →

More from coding & agent

coding & agent channel →