AI Inference Market Booms in Opacity Amid Trillion-Token Demand

The AI inference market is exploding—OpenRouter alone routes tokens at a 4.5 quadrillion annual run-rate—yet H100 pricing ranges from $2.2 to $8 per hour with no visibility into utilization or margins, leaving buyers and investors with little independent evidence of value.

2026-10-14 ~ 2026-10-15 · 2 related posts