AI Token Costs Exponentially Out of Control
FinanceYF5 · x · 2026-07-14
Chamath recently shared a discussion with his CTO: the company's AI token costs are doubling every 45 days, while downstream productivity gains have peaked at just 5%.
He argues the issue isn't just the cost, but the exponential volume of tokens required to iterate on next-gen capabilities, pushing against a bottleneck. He predicts that over the next 3-4 years, many companies will face a reckoning, and those who can exit should do so while valuations and funding remain high.
More from AGI Musings
- Closed frontier models may end up restricting APIs entirely, one researcher argues — xeophon · 2026-07-21
- Aging won’t be solved with $1 billion, says AI observer; hundreds of billions may be needed — DeryaTR_ · 2026-07-21
- Jeff Dean’s vision: build one huge system, then extract task-specific parts — JoshuaJBouw · 2026-07-21
- Agents are useful now, but local frontier inference is still too expensive — MannyKayy · 2026-07-21
- A market should price APIs, but not decide whether frontier AI keeps getting funded — McDonaghMatthew · 2026-07-21
- Samsung launches a robotics division to accelerate humanoid robot development — Polymarket · 2026-07-21