Clay's Claygent handled 5B+ queries, cut inference costs 47% with a model router
rhythmrg · x · 2026-10-28
Claygent, Clay's AI agent for GTM research, has processed over 5 billion queries. The team's key lesson: not every query needs a frontier model — smaller alternatives offer better cost and latency.
They trained and served a specialized router to pick the right model per task, cutting inference costs by 47% with no impact on answer quality — a replicable cost-optimization pattern for high-volume agent products.
Related event: Clay's AI Agent Handles 5B+ Queries, Cutting Inference Costs 47%(2 posts)→
More from coding & agent
- Adam Jacob: rebuild engineering around AI and craftsmanship comes back — RealGeneKim · 2026-10-28
- 5 models tested as Salesforce agents: Opus 87%, DeepSeek 82% at 1/75 the cost — TruthDeep8659 · 2026-10-28
- dotey argues multi-loop agents are inevitable: everyone will manage a fleet of Agents like a Manager — dotey · 2026-10-28
- Ghostty 1.4.0 ships after 7 months: first non-Kitty terminal with full Kitty graphics, security fixes — jedisct1 · 2026-10-28
- Stripe launches Link balance, stablecoin payment rails built for AI agents — jeff_weinstein · 2026-10-28
- 50-task Salesforce agent eval: GPT-6.1 Sol scores 72%, well behind Claude Opus at 87% — TruthDeep8659 · 2026-10-28