Spotify's Portal Cut Claude Code Token Usage by 90% With a Two-Mode Router
rseroter · x · 2026-09-04
Spotify Engineering's Portal platform cut Claude Code token usage by 90% by routing grunt work to cheap models. The insight: most of what coding agents do is I/O, not reasoning. With AI coding costs projected to exceed average developer salaries by 2028 — and a quarter of engineering leaders already burning $200–$500 per developer monthly on tokens — the fix requires no platform team. Portal's AiKA Modes are declarative agents on ephemeral runtimes (Lambda for agents): define instructions, pick a model like Gemini 2.5 Flash, attach MCP tools, call via CLI or API. The author built a 'bulk-reader' mode to handle multi-file questions cheaply, reserving frontier models for real reasoning.
More from coding & agent
- LukeW's Intent update: multi-agent coordination, workspaces, multi-device runs — LukeW · 2026-09-04
- Intent update coordinates swarms of agents with workspaces across devices — LukeW · 2026-09-04
- VC advice for agentic startups: pitch how your agent recovers from failures — atShruti · 2026-09-04
- WebMCP demo: an AI agent DJs in the browser with hundreds of direct tool calls — No_Guide_8697 · 2026-09-04
- Newsletters, not killer use cases, are what get users to trust agents with real email access — JanJanJaJa · 2026-09-04
- Kafka, Kafka Connect and Schema Registry exposed as native MCP tools — jkriket · 2026-09-04