Team livestreams open RL training of LoRA harness adapters for hermes, pi and opencode

yb2698 · x · 2026-11-06

yb2698 and ariG23498 are livestreaming RL training on Hugging Face of LoRA "harness adapters" for three coding harnesses (hermes, pi, opencode), built on LiquidAI's LFM2.5-24B, LFM3 and the recent TwIL-8B models. The idea: fine-tune LoRA adapters jointly on the harness and the target task using RL and open environments, making models more efficient and accurate in the pipeline. Everything — RL environments, reward-hacking attempts, eval results, training protocol — will be open-sourced.

Related event: Hugging Face Open-Sources Agent RL Training: Single-GPU LoRA Boosts Small Coding Agents(9 posts)→

Original post →

More from coding & agent

coding & agent channel →