79% of 2,880 LLM API recommendations went to just four big-cloud services
santiviquez · x · 2026-11-17
Core numbers from the experiment: of 2,880 recommendations without search, 2,282 (79%) went to Microsoft Azure Document Intelligence, Google Document AI, Gemini API, or AWS Textract, leaving just 5% for smaller startups.
The setup covered 10 document-processing use cases (financial tables, legal contracts, invoices, receipts, paper forms), each with 4-5 phrasing variants — direct recommendation requests, problem-first framings, casual asks — plus tasks asking models to write implementation code.
Related event: 3,600-Query Experiment: 79% of API Recommendations Go to Big Cloud(2 posts)→
More from Models
- Researchers Slam DeepMind for Skipping Control Evals on Carbon Model — jammastergirish · 2026-11-17
- 'Humans Also Read Linearly and Causally, So It's Not a Transformer Issue' — yacineMTB · 2026-11-17
- Fudan & OpenMOSS map the trade-off: long-context hybrids learn more, extrapolate less reliably — jiqizhixin · 2026-11-17
- Models favor their own APIs in code: Opus calls Claude API in 97% of implementations — santiviquez · 2026-11-17
- Search behavior gap: Opus searched in 10/60 answers, GPT models searched every time — santiviquez · 2026-11-17
- Hy4 Flash hands-on: DeepSeek-V4.1-level quality at ~1/15 the cost, 60% faster — IlovedamemesUwU · 2026-11-17