$2900 for 64GB VRAM? Dev Weighs AMD GPU Upgrade Headaches
milkipedia · reddit · 2026-08-07
A developer is considering replacing a single RTX 3090 with two AMD Radeon Pro W7900s (referred to as R9700) for about $2900 to upgrade from 24GB to 64GB VRAM for local LLM inference.
While the large VRAM capacity is highly attractive, he is concerned about practical hardware hurdles. Beyond the CUDA vs. ROCm ecosystem differences, the main issues are power cable adapters (8pin to 16pin) in his workstation and the ability to safely power-limit the AMD cards. He asks the community if this upgrade path is worth the hassle.
More from Infra
- Trillion-Dollar GPU Bets and AGI Delays: Is the AI Boom Sustainable? — Positive_County_3493 · 2026-08-07
- a16z on Open Weight Models: Cost and Control Are the Core Advantages — FinanceYF5 · 2026-08-07
- SK Hynix 2Q26 OPe Forecast Misses Consensus Due to High HBM Mix and LTA Effects — zephyr_z9 · 2026-08-07
- Building a Private RAG System for 50 Users: A Mac Mini Cluster Proposal — rogo725 · 2026-08-07
- Google TPU v7s Are Not Sold Cheap, Hardware Costs Remain High — zephyr_z9 · 2026-08-07
- Indie Developers Report Meta AI Scrapers Overloading Their Servers — Polymarket · 2026-08-07