Vercel AI Gateway logs add Sessions view with cache-optimizing session affinity
nicolascraske · x · 2026-10-19
Vercel shipped a Sessions view in AI Gateway logs that groups requests into conversations and shows how session affinity routed each one.
- Each row shows the coding agent or app that ran the session (Claude Code, Codex, Cursor, etc.), plus cost, models, providers, and cache hit rate across every turn.
- Session affinity routes each turn to the provider that served the previous one, so more of the prompt is read from cache when a session stays on one provider. It runs by default on text and chat requests.
- Sessions can be filtered by turns, client, model, provider, authentication, or cost; single-turn sessions are hidden until the minimum turns filter is cleared.
- Developers can group requests manually by sending the same sessionId in providerOptions.gateway or the same x-session-id header on every request.
More from coding & agent
- AI agents cost 20x more than conventional software, warns architect's enterprise breakdown — DavidLinthicum · 2026-10-19
- Indie dev shares UI iteration workflow: three mock options for every visible change — SeanOliver · 2026-10-19
- Reddit dev splits Claude Code tasks by complexity to cut token burn, but sub-agents backfire — alatmaca · 2026-10-19
- Opus 5.5 builds a realistic 3D ocean exploration scene in 4,100 lines of code — techartist_ · 2026-10-19
- DeepSeek V4.1 gets smarter but discards its best ideas; Opus struggles to rescue the mess — teortaxesTex · 2026-10-19
- eduframe-mcp open-sources natural language lead management for Eduframe via MCP — modelcontextprotocol · 2026-10-19