Agent Training Data: More Tools, Harder to Generate
Shahules786 · x · 2026-07-14
This thread discusses how to generate post-training data that genuinely enhances agent capabilities. The core insight is that in enterprise-level, multi-turn long tasks, the number of tools expands exponentially. A single domain might have 100+ tools, and three domains easily exceed 300. Simply stuffing the tool list into the context degrades task performance.
The thread highlights three papers:
- PlanBench-XL: Constructs a tool environment closer to real-world scenarios, simulating agents working without seeing the full toolset;
- TMax: Focuses on synthesis and training for harder tasks;
- Autodata: Uses multi-model collaboration to determine if a task is feasible and trainable.
The author notes these papers are already influencing their internal practices: synthesizing tasks from tool graphs and combining multiple models of varying capabilities to assess trainability, with the ultimate goal of integrating these methods into a customizable, automated data pipeline.
Related event: PlanBench-XL Tackles Agent Tool Retrieval at Scale(3 posts)→
More from coding & agent
- Anthropic says Claude Code helped its developers migrate 10 code packages in one month — trq212 · 2026-07-22
- DIYing a Flight Stick into an AI Keyboard: A Hardcore Coding Agent Workflow — thorax · 2026-07-22
- Building a Secure AI Agent Gateway: Self-Hosting OAuth for Multiple SaaS Apps — Defiant_Cod_2654 · 2026-07-22
- Rowboat launches as an open-source, local-first AI coworker with memory — ycombinator · 2026-07-22
- Reddit user chains Ideogram 4 and Krea2 to mimic bbox-based image positioning — v3lh0t05c0 · 2026-07-22
- Apollo Cuts AI Assistant Skill Dev Time by 85% with Deep Agents — LangChain · 2026-07-22