DeepSeek reportedly earns $38 per GPU-hour on tokens — what does it mean for GPU pricing?
andrew_n_carr · x · 2026-10-21
andrewncarr cites figures that DeepSeek is making about $38 per GPU-hour on token inference and asks what that implies for where cost per GPU-hour heads — a discussion on inference unit economics and the gap between GPU rental prices and compute returns.
More from Infra
- ByteDance, Alibaba, Tencent order 3M+ Nvidia RTX PRO 5500 cards worth $35B, Reuters reports — SumitGup · 2026-10-21
- TorchTPU demo: unified vLLM & SGLang backend for LLM serving on TPUs — Rob_Mulla · 2026-10-21
- Google, Red Hat release llm-d 1.0: open K8s-native distributed inference stack — rseroter · 2026-10-21
- acs infra launches free base model API offering Llama 3.1 8B and 405B for LLM psychology researchers — amplifiedamp · 2026-10-21
- Developer Moves AI Agents to a Dedicated Linux Workstation Using Incus System Containers — kevinkern · 2026-10-21
- Nvidia guides 70% growth citing unmet AI demand, while media panics over a $500M Korean neocloud IPO — firstadopter · 2026-10-21