Open-source TrueForge harness matches Claude managed agents' accuracy with 63% fewer tokens
Background-Job-862 · reddit · 2026-09-03
TrueFoundry open-sourced TrueForge, a model-neutral general agent harness (MIT, OpenAI-compatible endpoints, MCP, subagents, approvals, sandbox integration), and benchmarked it on 14 DevRev Enterprise-Bench tasks with a blind judge:
- Claude Managed Agents + Opus 4.8: 11/14 solved, $11.8/run, 10M tokens/run
- TrueForge + Opus 4.8: 11/14 solved, $8.6/run, 3.7M tokens/run, 19 vs 32 tool calls
- TrueForge + GLM-5.2: 11.7/14 solved, $3.0/run — roughly 75% cheaper
The gains come from the agent loop itself: less carried context, compaction, fewer tool calls, keeping large outputs out of context. Caveats: no first-class tracing/eval, bring-your-own sandbox, lossy compaction. Benchmark methodology is published for reproduction.
More from coding & agent
- Inanimate pre-announces WORKS: four promptable agent devices shipping fall 2026 — genmon · 2026-09-03
- Why Agents Slow Down After Step 8: Devs Compare Profiling Notes — NewBass7883 · 2026-09-03
- Google study: hallucinations are lost keys, not empty shelves — CoT recovers up to 65% of facts — bendee983 · 2026-09-03
- Who Decides What an AI Agent Can Access? Data Governance Remains Unsolved — AgileExcuse859 · 2026-09-03
- The Human Handoff May Be the Most Underrated Part of AI Agent UX — iMaurice8888 · 2026-09-03
- Solo builder crawls 10B+ records a day to put the internet in an analytical database via MCP — AaronBergman18 · 2026-09-03