KV cache economics: why a $200 Claude plan can hand out $14,000 of API-equivalent tokens and still profit

rachittshah · x · 2026-11-21

Gergely Orosz explains why inference is so profitable: KV cache reads are very cheap and speculative decoding makes sessions efficient, and coding workloads lean heavily on both.

Original post →

More from Infra

Infra channel →