Uber compacts Claude Code sessions at 400K tokens; per-request cost down 34%

rohanpaul_ai · x · 2026-11-20

Uber hard-compacts engineers' Claude Code sessions at 400K tokens — even on million-token models — after exhausting its AI budget. Weekly agent requests grew 9.4x from February to August and weekly active users grew 7x, yet overall AI spend has stayed roughly flat since April. With the model held constant, cost per 1,000 requests fell 34% from peak and cost per session fell 52% from its June peak. Uber still runs MCP servers, but agents reach them via command-line tools tied to a central MCP gateway, since preloading descriptions for 100+ tools costs 50K-70K tokens before the first prompt.

Original post →

More from coding & agent

coding & agent channel →