AI token prices come down to electricity, GPU rent and profit margins
davidmanheim · x · 2026-07-27
The thread argues that AI model prices can be decomposed into electricity, amortized hardware costs or GPU rental, and profit margin. The author’s broader point is that token pricing is ultimately a distribution question: who captures the value created by scarce compute.
The follow-up adds that hardware prices in a free market are set by what buyers are willing to pay, and when supply is constrained, the relevant price is not the highest-value use but the second-highest-value use.
Related event: AI Inference Services Cost Up to 15x More Than Renting GPUs(4 posts)→
More from Infra
- Jensen Huang backs open-source LLMs, but GPU costs remain the real barrier — pascalefung · 2026-07-28
- Nvidia’s $750 billion AI deals reignite fears of circular financing — brainquantum · 2026-07-28
- SSI Signs $410M Compute Deal with Amazon, Bulk of Its Fundraising — TechCrunch AI · 2026-07-28
- Taiwan Detains Nvidia Employee in Widening AI Server Smuggling Probe — The Decoder · 2026-07-28
- RBC says a DIY AI replacement for Office could cost 11 times more over five years — TiernanRayTech · 2026-07-28
- LangChain says its NVIDIA partnership helps enterprises own domain intelligence — LangChain · 2026-07-28