ToolGrad flips tool-use data synthesis: answer-first pipeline hits ~100% pass rate
tokenbender · x · 2026-09-16
ToolGrad (ACL 2026 Findings) inverts the standard tool-use dataset synthesis paradigm: instead of generating user queries first and annotating tool-use chains via DFS, it builds valid tool-use chains iteratively guided by textual "gradients," then synthesizes matching queries. The resulting ToolGrad-500 dataset has more complex tool use, lower cost, and near-100% pass rate, and models trained on it beat baselines trained on expensive datasets and proprietary LLMs. Code, data, and models are open-sourced. The poster highlights a reusable recipe: collect valid outcomes, derive likely goals, mutate for diversity, verify, train.
Related event: 'Answer-first' synthetic data method hits nearly 100% pass rate(2 posts)→
More from Research
- Asynchronous Flow Map Language Models Generate All Tokens in a Single Forward Pass — kalyan_kpl · 2026-11-02
- NVIDIA's Kumo Is a Family of Four Tabular Foundation Models, Not Just One — pandeyparul · 2026-11-02
- Economist Aaroth: fast agreement dynamics survive without Bayesian updates or accurate priors — Aaroth · 2026-11-02
- ELLIS names 160 new ML Fellows and Scholars for 2025–2026 — JJitsev · 2026-11-02
- Meme turn 50: Aumann's 'Agreeing to Disagree' paper anniversary — Aaroth · 2026-11-02
- Anthropic: analysts unknowingly adopted their agent's secret lean 86% of the time — shoumikgoswami · 2026-11-02