Troubleshooting Multi-GPU Support for Deepseek V3 in llama.cpp
erazortt · reddit · 2026-08-22
A user is struggling to optimize llama.cpp for Deepseek V3 (120GB quantized) across two GPUs (Blackwell 5000 48GB + RTX 3090 24GB). Attempts to use --split-mode layer or manual tensor offloading resulted in allocation failures or slower speeds compared to running on a single GPU with CPU offload. The post seeks advice on correct multi-GPU configuration.
More from coding & agent
- YC F26's Praxis launches AI agents to run law firm ops end to end — ycombinator · 2026-10-16
- Developer builds inter-agent messaging for his AI agents — complete with message undo — baditaflorin · 2026-10-16
- iOS 'dots' workflow: one Siri command turns screenshots into a background shopping and saving agent — nickbaumann_ · 2026-10-16
- Your widget tree is already a list of options: where Jev fits in Flutter — rseroter · 2026-10-16
- How OpenAI's Codex went from failed side project to 40M weekly users in under a year — danshipper · 2026-10-16
- Photon 2.0 launches unified messaging API for AI agents across iMessage and more — Scobleizer · 2026-10-16