The Token Curve: token demand compounds while prices collapse — who pays the floor?

AccBalanced · x · 2026-08-18

Tim Davis published an essay, "The Token Curve," on how heterogeneous compute will reshape and reprice the long-contracted GPU market. Core thesis: portability doesn't create heterogeneous compute — it turns already-existing heterogeneous capacity into supply the market can actually use; once that capacity is production-ready at scale, it will reset the marginal cost of inference and reprice fixed GPU commitments.

Davis splits "demand" into three measures growing at different rates:

Usage volume (tokens actually served) is compounding on one of the fastest adoption curves the industry has recorded;
Inference revenue = rapidly rising volume × rapidly falling realized prices, so it grows far slower than token volume;
Infrastructure capex is a forward capital commitment against forecasts of both, deployed in step functions.

He argues financing terms will set the cost floor for every token served, and today's financiers hedge token-price deflation through short amortization, customer contracts, and credit wrappers — rather than underwriting against a transparent forward token-cost curve.

Original post →

The Token Curve: token demand compounds while prices collapse — who pays the floor?

More from Infra