Decision models now take 26% of Vercel gateway requests; new teams pick Anthropic 2:1
markjeffrey · x · 2026-11-22
Vercel's AI Gateway Production Index (Nov 2026), based on 100T+ tokens routed monthly:
- Decision models exploded: in six weeks they grew to 1 in 4 gateway requests while costing half a cent per dollar spent; 1/3 of paid teams used one in October, rising to 7 in 10 among teams processing 10B+ tokens/month.
- Vendor split: OpenAI and Anthropic reach about the same share of paid teams, but October's new teams picked Anthropic nearly 2:1; OpenAI's share of gateway spend is up two-thirds since December.
- Voice models: usage among paid teams rose from 4% in July to 11% in October.
- Faster churn: over half of LLM requests now go to models less than two months old (up from under 30%); within a month of a model's usage peak, 3 in 4 teams have moved on.
The poster notes a prior guest estimate that 20–30% of AI prompts could route to decision models — Vercel's 26% figure lands right on it.
More from Infra
- First INT4 model lands in int8-vllm: 4x used MI100 hits 222 tok/s decode — 1ncehost · 2026-11-22
- B300 GPUs clearing at $18/hour and sold out as a compute credit crunch looms — AccBalanced · 2026-11-22
- AMD owns the SC26 floor: Azure HDv2 on 500-core Venice EPYC, Helios open fabric — AccBalanced · 2026-11-22
- SC26: Google pitches TPUs to GPU-default devs, Microsoft shows off HBv5 — AccBalanced · 2026-11-22
- Gary Marcus mocks the biggest data center ever, tied to OpenAI, SB Energy and Nvidia — GaryMarcus · 2026-11-22
- AI stock selloff is a leverage squeeze: neoclouds down ~63%, CoreWeave CDS spikes — tengyanAI · 2026-11-22