Teknium's Hermes telemetry shows 94% of tokens are cache reads, only 0.6% uncached

Teknium · x · 2026-11-22

Teknium shared token-mix telemetry from opted-in Hermes users (excluding user-added custom providers): cache reads account for 94.11% of all tokens, cache writes 4.06%, uncached input just 0.6%, and other 1.23%.

He notes the mix would shift if custom providers with poor cache quality control were included. The numbers illustrate how heavily current agent-style workloads rely on prompt caching — most input tokens are repeated context hitting the cache.

Related event: Teknium Reveals Over 90% of Hermes User Tokens Are Cache Reads(2 posts)→

Original post →

More from Infra

Infra channel →