Hermes adapter solves a SWE-Bench Pro task in 35 tool calls where the base Qwen3.8 model failed
yb2698 · x · 2026-11-19
Following NousResearch's Hermes adapter release for Alibaba's Qwen3.8-27B, the author shows a real SWE-Bench Pro (hard 51) task: the base model broke the test file and burned its 100-step budget, while the adapted model fixed the bug, verified task scenarios, and passed in just 35 tool calls. The adapter lifts SWE-Bench Pro pass@1 from 29.4% to 43.1% (51.0% with xhigh thinking) and Terminal Bench 2.1 from 44.7% to 58.8%, matching base-model xhigh performance with thinking off at 3.5–4.4× fewer tokens.
More from coding & agent
- NousResearch's Hermes adapter lifts Qwen3.8-27B agent scores: SWE-Bench Pro 29.4%→43.1% at 4× fewer tokens — yb2698 · 2026-11-19
- One Amazon EBS gp3 command scales a 10M-vector Weaviate index 26×, from 9.8 to 260 QPS — philipvollet · 2026-11-19
- Human Principal launches private beta: cryptographic proof a human is behind your AI agent — yenkel · 2026-11-19
- GPT-6.2 builds code-only 3D fairy town and a deep-sea civilization in 10–20 minutes — OpenAIDevs · 2026-11-19
- Designers are being asked to do interior design while ignoring the architecture — round · 2026-11-19
- Dev builds a playable FPS in under 5 hours with GPT-6.2 and Unreal Engine 5.9 MCP — OpenAIDevs · 2026-11-19