Why AI Bills Are Rising Despite Cheaper Tokens
sanjaykalra · x · 2026-07-09
The post notes that while the price per token has dropped 75% this year, enterprises' total AI bills are still rising because agentic workflows consume 5 to 30 times more tokens per task than regular chat queries. It also mentions that Uber once spent its entire annual AI budget in four months, and procurement models are shifting from per-seat licensing to consumption commitments.
Related event: The AI Bill Paradox: Lower Token Prices, Higher Total Costs(2 posts)→
More from Infra
- 12 KV Cache Reduction Techniques Every AI Engineer Should Understand, Explained — blaizedsouza · 2026-09-11
- The shadow GPU capacity market is formalizing, with Meta selling excess compute to outside buyers — DavidLinthicum · 2026-09-11
- Engram's random reads don't suit SSDs; CPU-memory over NVLink could serve all 72 GPUs — bookwormengr · 2026-09-11
- 80% of the DIY LLM inference hype posters have already quit — it's brutally hard systems work — abhijithneil · 2026-09-11
- Hugging Face's Ultra Scale Playbook: a free book on training LLMs on GPU clusters — mdancho84 · 2026-09-11
- Is inference latency becoming the biggest bottleneck for production AI agents? — Euphoric_Sea632 · 2026-09-11