RL-Trained Hermes LoRA on Qwen3.8-27B Adds +13.7 Pts on SWE-Bench Pro While Using Fewer Tokens

yb2698 · x · 2026-11-19

A developer released a GGUF LoRA adapter for Qwen3.8-27B, trained with RL (TRL's AsyncGRPOTrainer + OpenEnv) on real Hermes Agent sessions in an HF sandbox, with safeagents checks on every tool call.

The author openly flags caveats: the thinking comparison holds only under a 131k window with one attempt per task; the GGUF file wasn't re-evaluated through llama.cpp; scores aren't comparable to the official Qwen3.8-27B card. All evaluation trajectories are linked.

Related event: Nous Releases RL-Trained Hermes Adapter for Qwen3.8-27B(2 posts)→

Original post →

More from coding & agent

coding & agent channel →