Inside Uber's AI infra: Model Gateway, AIFX, and 50% token cost cuts
The Pragmatic Engineer · rss · 2026-10-15
The Pragmatic Engineer interviews Uber Distinguished Engineer Uday Kiran Medisetty on the company's dev tooling and AI infrastructure: a model-agnostic Model Gateway with AI Guard middleware, the AIFX wrapper that lets engineers switch between Claude Code/Codex/OpenCode without losing settings, hybrid AI spend tiers that cut token costs 50%, CI under 'code red' after jobs doubled in a year, PRs tagged by type as PR velocity loses meaning, and how the engineer's job has shifted to context engineering and verifying agent output.
More from coding & agent
- Index Network open-sources Social Discovery Protocol: agents negotiate fit on your behalf — carsonfarmer · 2026-10-23
- Installed a formal-verification skill: it silently installed Java, MacBook runs 10 degrees hotter — zealcaiden · 2026-10-23
- OpenAI's Decisions API hits GA: near real-time routing up to 10x faster than GPT-6 Luna — OpenAIDevs · 2026-10-23
- Ruff author warns: upgrade Node/Bun now — --use-system-ca still accepts the eMudhra cert — charliermarsh · 2026-10-23
- Proof of Agent: paste one prompt and your AI mines, grades, and self-governs — adamamcbride · 2026-10-23
- DeepLearning.AI weekly: GPT-6.1 hits 97.9% byte parity on COBOL migration — DeepLearningAI · 2026-10-23