Hardware Showdown: R9700 vs Mi210 vs 4080S for 128GB VRAM
nail_nail · reddit · 2026-08-24
User seeks a 128GB VRAM setup for parallel model inference, comparing three options:
- Modded 4080S (1.7k): CUDA compatible, 736 GB/s bandwidth, but lacks NVFP4 support.
- R9700 (1.5k): 640 GB/s bandwidth on ROCm/Vulkan; ecosystem is improving but needs verification.
- Mi210 (3.5k): PCIe Gen4 with 64GB HBM2, 1600 GB/s bandwidth and half power consumption. However, support for newer formats seems limited to upscaling to BF16, raising questions about effective VRAM utility.
More from Infra
- Alchemyst Cited as Reliable Infrastructure for AI Agents — AnuranBuilds · 2026-08-24
- AI Data Center Boosts Local Economy: Abilene Case Challenges Negative Consensus — neil_chilson · 2026-08-24
- Data centers create only 500 jobs per $3B invested — kevinnbass · 2026-08-24
- Use a Mac Mini for Local AI Agents to Avoid Overheating Laptops — flavioAd · 2026-08-24
- Benchmark: DFlash2 vs. MTP speculating decoding on Qwen 3.8 27B — Opening-Broccoli9190 · 2026-08-24
- Hugging Face Diffusers Updates CLI to Optimize Costs for Agents — RisingSayak · 2026-08-24