Same model scores 62% vs 33% across agent harnesses; Hugging Face open-sources multi-harness RL guide
huggingface · x · 2026-10-02
Hugging Face 团队发现:同一模型、同一权重,在一个 agent harness 中得分 62%,在另一个只有 33%。他们发布了年度最实用的多 harness RL 指南,完全开源。
核心技巧:不动 harness 本身,把模型指向一个代理(proxy)。代理支持编码 agent 用的全部四种 API 格式(OpenAI Chat Completions、OpenAI Responses、Anthropic Messages、Gemini),记录 vLLM 采样出的精确 token id 和 logprobs,并在其上训练。Claude Code、Codex、OpenCode 一行代码都不用改。
结果:
- 同时在 4 个 harness 上训练,Liquid AI 的 LFM2.5-2.6B 从 42% 提升到 54%
- 因给「更少步数完成任务」小奖励,工具调用减少 31%
- 只在 OpenCode 上训练把其成绩从 34% 提到 58%,但多 harness 训练的模型提升更均衡
Related event: Hugging Face Open-Sources Ultimate Guide to Multi-Harness RL(6 posts)→
More from coding & agent
- Lightfoot: Exact, Model-Free Document Deletion for GraphRAG in 14 Seconds — JeremyCMorgan · 2026-11-20
- LangChain adds natural-language AI Search to LangSmith trace filtering — LangChain · 2026-11-20
- OpenAI Touts GPT-Live-1.1 for Building Voice Agents in Your Apps — OpenAIDevs · 2026-11-20
- LexiEngine: Rust inference engine for AMD runs 27B at full 262k context 47% faster than llama.cpp — W61k3r · 2026-11-20
- ENTIA launches Entity Verification MCP: 52M+ business records across 34 countries for AI agents — modelcontextprotocol · 2026-11-20
- Personal Agents Weekly: a roundup of the personal-agent ecosystem — heyneighbor · 2026-11-20