ProgAgent: training agents with programmatic tool calling beats direct tool calling

hkust-nlp · hf · 2026-10-15

HKUST researchers introduce ProgAgent, a full training stack for Programmatic Tool Calling (PTC), where tools are invoked via executable code and intermediate results live in runtime variables instead of the context. The stack includes a pipeline for synthesizing verifiable long-horizon tasks, a lightweight PTC runtime, and a two-stage training recipe. Using only 215 instantiated tasks, ProgAgent beats comparable-size baselines across four benchmarks; on LOCA-bench, ProgAgent-14B hits a 30.7% pass rate at a 64k-token environment state where baselines score zero. Cross-harness experiments show PTC-trained models outperform DTC-trained ones under both evaluation interfaces, suggesting the training benefit goes beyond the interface.

Original post →

More from coding & agent

coding & agent channel →