Running DeepSeek at 10 tok/s on an RTX 5090 costs more in electricity than API calls
DeMischi · reddit · 2026-10-25
A Redditor ran DeepSeek locally on an RTX 5090 (64GB DDR5, 4TB NVMe) via Strata, hitting about 10 tok/s with 8K context. Their verdict: at this speed the API is cheaper than the electricity—but it does run. Useful real-world reference for similar local deployment setups.
More from Infra
- Samsung reportedly using TSMC 3nm for Nvidia's next-gen NVHBM custom chip base dies — Beth_Kindig · 2026-10-25
- No AI bubble yet: revenue per GPU minus rental is the real equation — PTrubey · 2026-10-25
- AI labs are flipping GPU contracts: H100/B200 rental prices up 2-3x since early lock-ins — Yuchenj_UW · 2026-10-25
- Swarms open-sources RouteHub, an LLM gateway that imports 190x faster than litellm — KyeGomezB · 2026-10-25
- Radeon 9700 Prices Double in a Month, Hurting Personal Inference Server Builds — UltramanQuar · 2026-10-25
- New blog demystifies GPU communications, from page tables to NVLink, via SGLang internals — BanghuaZ · 2026-10-25