Hugging Face releases harness adapters: safe RL inside pi, opencode and hermes

yb2698 · x · 2026-11-06

Hugging Face ships "harness adapters": one LoRA per model-harness pair, trained with RL on verifiable tasks inside unmodified agent harnesses (pi, opencode, hermes). Adapters make fewer tool calls while keeping accuracy; safeagents proxy blocks reward hacking by inspecting every tool call; training environments come from public coding sessions via Repo2RLEnvs; even the never-agent-trained TwIL-8B reasoning model learns.

Related event: Hugging Face Open-Sources Harness Adapters: LoRA + RL Boosts Small Models in Real Agent Harnesses(17 posts)→

Original post →

More from coding & agent

coding & agent channel →