What to Run on a 4x RTX 3090 Local AI Rig
whity2773 · reddit · 2026-07-13
The author showcases a heavy-duty hardware setup for local AI and asks for recommendations on what models to run or projects to build on this machine.
The configuration includes:
- Ryzen 9 9900X
- 96GB DDR5 (48GB ×2)
- ASUS X870E ProArt
- 4x RTX 3090
- 2x NVLink
- 2TB PCIe 5.0 NVMe
- 1600W + 1200W power supplies
They mention having already built some software products on this machine, including a transcription tool for dermatology clinics that converts consultation recordings into doctor notes for further editing and uploading to the clinic's system. The post primarily seeks model and workload advice for this multi-GPU local setup.
More from Infra
- Nebius says SlimSpec speeds speculative decoding 8–9% without shrinking the vocabulary — Arindam_1729 · 2026-07-21
- NVIDIA brings its Cosmos 3 Edge world model to Jetson for on-device robot control — liu_mingyu · 2026-07-21
- A silicon photonic reservoir chip compensates fiber distortion in real time at 28 Gbps — bravo_abad · 2026-07-21
- Chamath says open-sourcing Grok would push AI margins from models to infra and apps — Dan_Jeffries1 · 2026-07-21
- EU AI competitiveness is under pressure as firms double down on chips, ethics, and talent — nordicinst · 2026-07-21
- AI bottlenecks are shifting to memory, optics, yield control and power — thedealdirector · 2026-07-21