CMP170HX Mining Cards Tested: 4x64GB for LLM Inference, Performance and Value Analysis
m94301 · reddit · 2026-08-12
User m94301 tests CMP170HX mining cards (4x8GB modded to 64GB each) for LLM inference. Benchmarks show single-card runs 20B models, multi-card runs up to 120B with 1M context. Provides token generation speeds, prefill speeds, and discusses PCIe bandwidth, power. Author says at $200 it's a steal, but performance is Ampere-class.
More from Infra
- Albedo/SN97 Moves LLM Traffic to Engy AI: Worst-Case Stalls Drop from 75s to Under 2s — markjeffrey · 2026-08-12
- RTX 5090 Test: MiniMax H3 Generates 1080P 192-Frame Video in 2 Minutes — lxe · 2026-08-12
- Running Local LLMs on Old Hardware: Automating Tasks with a 10-Year-Old GTX 1060 — AGuyCalledBath · 2026-08-12
- CoreWeave Q2 Revenue Hits $2.6B with $104B Backlog — wandb · 2026-08-12
- AMD FastFlowLM 1.0 Released and Integrated into the ROCm Ecosystem — AnushElangovan · 2026-08-12
- Oracle's AI Infrastructure Push Turns Cash Flow Negative, Plans Major Layoffs — rohanpaul_ai · 2026-08-12