AI token prices come down to electricity, GPU rent and profit margins
davidmanheim · x · 2026-07-27
The thread argues that AI model prices can be decomposed into electricity, amortized hardware costs or GPU rental, and profit margin. The author’s broader point is that token pricing is ultimately a distribution question: who captures the value created by scarce compute.
The follow-up adds that hardware prices in a free market are set by what buyers are willing to pay, and when supply is constrained, the relevant price is not the highest-value use but the second-highest-value use.
Related event: AI Inference Services Cost Up to 15x More Than Renting GPUs(4 posts)→
More from Infra
- Together AI adds canary rollouts for zero-downtime model upgrades on dedicated inference — togethercompute · 2026-09-23
- Dedicated Hardware for Running AI Agents at Scale Arrives — cyrilzakka · 2026-09-23
- Ternary Bonsai 2 27B: 5.9GB weights retain ~95% of full-precision reasoning — cephaloform · 2026-09-23
- Qwen 27B runs 24hr unattended on one RTX5090, builds full Postgres-SpringBoot-React spreadsheet app — anglepoiselife · 2026-09-23
- OpenRoboto Shift launches: decentralized egocentric video data network for robot brains — markjeffrey · 2026-09-23
- Engineer describes designing digital circuits that recycle most of their energy — MikePFrank · 2026-09-23