Super-adapter lifts SWE-Bench Pro by 10+ points, cuts tool calls up to 73%

yb2698 · x · 2026-11-20

A hands-on evaluation with the super-adapter shows SWE-Bench Pro (hard 51) rising from 45% to 61% on Hermes Agent and 47% to 67% on OpenCode, with pi steady at 74%. Terminal-Bench 2.1 gains 4-6 points across harnesses; the mean over 6 pairs goes from 55.5% to 63.5%. On efficiency, tasks both solve need 53-73% fewer tool calls with thinking off, and 19-48% fewer with it on.

Related event: yb2698 merges a week of LoRA adapters into one super-adapter, boosting Qwen coding scores by up to 20 points(9 posts)→

Original post →

More from coding & agent

coding & agent channel →