Open model inference is booming: TogetherAI tokens grew 10x from Q1 to Q2, analysis used stale data
GutenLeinad · x · 2026-09-21
- Pushing back on an analysis claiming open models see little serious use, GutenLeinad notes it relies on Q1 or older data, badly outdated.
- Actual growth: TogetherAI's token numbers grew more than 10x from Q1 to Q2, Fireworks roughly 3x, Baseten is now as large as the other two, and OpenRouter grew over 5x.
- Takeaway: open-model hosters are niche players, but their token consumption is exploding, so stale figures understate real open-model usage in products and enterprise.
Related event: Open-Source Models at ~10% of AI Revenue? Analysis Slammed as Outdated(6 posts)→
More from Infra
- Sam Altman? No—Bezos Calls for Nuclear-Powered Offshore Data Center Platforms — beffjezos · 2026-11-04
- SpecPilot agent boosts speculative decoding from 4.46× to 10.87×, no retraining — pmttyji · 2026-11-04
- NEURA launches Neuron AI, but Europe's Physical AI test is whether the stack matures together — ingliguori · 2026-11-04
- S3-based databases cache in memory and NVMe, making disk vs S3 latency gap smaller than expected — mgill25 · 2026-11-04
- gpu-unlock project claims up to 2x FP16 tensor throughput for RTX 20/30/40 cards — paranoidray · 2026-11-04
- These 10 GPU optimization papers are why your model runs fast today — NandoDF · 2026-11-04