Same 10k-Token Budget: Hermes Adapter Solves 51% of TB-2.1 vs Base Model's 28% with xhigh Thinking

yb2698 · x · 2026-11-19

Follow-up data on the Qwen3.8-27B Hermes adapter, comparing thinking vs no-thinking: within a 10k-token budget per task, the adapter solves 51% of TB-2.1 and 39% of SWE-Bench Pro, while the base model at xhigh thinking manages only 28% and 0%. Median tool calls on commonly solved tasks drop from 23 to 7 (TB-2.1) and 63 to 28 (SWE-Bench Pro). The author also demos a real SWE-Bench Pro task where the base model breaks the test file and exhausts its 100-step budget, while the adapter fixes the bug and passes in 35 tool calls.

Related event: Hermes Adapter Beats Base Model in Real-World Benchmarks(2 posts)→

Original post →

More from coding & agent

coding & agent channel →