Nous Research on Scaling Agent Tools: Defer Everything Behind Tool Search

Teknium · x · 2026-11-17

Responding to a complaint that tool definitions bloat agent contexts (79-80K tokens of base prompt vs a 64K window), Nous Research's Teknium explains their fix: a tool-search mechanism where all tools are deferred loading by default except a few core ones, making large tool sets far more scalable.

Related event: Nous Research Tackles Agent Context Bloat with Lazy Tool Loading(2 posts)→

Original post →

More from coding & agent

coding & agent channel →