Developer processes 100B tokens, with 98% cache hit rate
DeryaTR_ · x · 2026-08-24
A developer shared usage stats: over 100 billion tokens processed, with >98% cached. Even excluding cache, at least 1 billion tokens were consumed in the last 6 months alone, marking a 100x increase from a year ago.
More from AGI Musings
- Why do mainstream LLMs feel male-coded? Industry reflects on gender bias — flowersslop · 2026-08-24
- Humanoid robot economics: can a handheld blender and workbot replace your washing machine? — teortaxesTex · 2026-08-24
- AI may aid discovery of new sports strategies like Fosbury Flop — jakedahn · 2026-08-24
- AI store manager fired a worker, but humans still supplied the spine — meatyminus · 2026-08-24
- Gary Marcus on AI's Comms Problem: Extinction vs Utopia Tradeoff — GaryMarcus · 2026-08-24
- AGI May Arrive First in Hard Tech Due to Objective Feedback Loops — imjustnewatai · 2026-08-24