Running the actual break-even math on buying vs renting an H200: 60% utilization over 2 years wins
recentheartbroken · reddit · 2026-09-26
The author ran the real rent-vs-buy numbers for an H200 box and got counterintuitive results.
Baseline figures
- An 8-GPU HGX H200 server costs roughly $320k–420k; $370k is a reasonable midpoint
- Median on-demand H200 price across 34 providers is about $4.40/GPU-hour as of Sept 18 ($2–3 is spot pricing), i.e. $35.20/hour equivalent
Hardware-only break-even
- 14.4 months at 100% utilization
- 24 months at 60%
- 36 months at 40%
Four uncounted costs: power and cooling (colo cage quote exceeded budget), depreciation (thin resale on last-gen parts — halve any assumption), your own time, idle hours.
Conclusion: owning wins at 60% sustained utilization over two years; below 40%, rent. Idle capacity can be sold to offtake networks to offset costs.
More from Infra
- Samsung, Oxford and PKU propose TrOPD to distill frontier-model reasoning into on-device small models — jiqizhixin · 2026-09-26
- Germany and the Netherlands put €40m into a challenge to design AI chips with AI — VraserX · 2026-09-26
- AMD Claims One Factory Box Can Run 2.3x More Software Workers — shashib · 2026-09-26
- Token Prices Fall via Subsidies, Moore's Law via Manufacturing — Different Drivers — HanchungLee · 2026-09-26
- KV cache transplants on Qwen3.8-27B: start at Q6, hand off to Q3, beat static quant — wadeAlexC · 2026-09-26
- Google open-sources GKE agentic migration for AI-assisted EKS-to-GKE moves — rseroter · 2026-09-26