Counting cached input tokens in total usage is incredibly dumb

cHHillee · x · 2026-08-24

The author points out that when people discuss their token usage, they often include cached input tokens in the total count, which they describe as "incredibly dumb."

Original post →

More from Infra

Infra channel →