Qwen3.8-27B Benchmarks: RPC inference tests across AMD and Nvidia GPUs
tabletuser_blogspot · reddit · 2026-08-17
The author benchmarked Qwen3.8-27B inference using llama.cpp RPC across various hardware setups. Configurations tested include a solo RX 7900 GRE, a RX 7900 GRE paired with a GTX 1080Ti, and a GTX 1080Ti with dual P102-100 GPUs. Results show that the 16GB RX 7900 GRE struggles with VRAM capacity. With RPC offloading, Q4KM quantization achieved throughput between 71-106 t/s, while Q6K reached 80-116 t/s. Notably, using three GPUs offered no speed advantage over two GPUs, only increasing load times.
More from Infra
- First AA-AgentPerf results: NVIDIA Vera Rubin NVL72 delivers up to 5.7x throughput per MW vs GB300 — ArtificialAnlys · 2026-10-16
- Vera Rubin NVL72 first benchmarks: up to 5.7x throughput per MW vs GB300 — ArtificialAnlys · 2026-10-16
- NVIDIA Vera Rubin NVL72 hits up to 5.7x GB300 throughput per MW on agent benchmark — ArtificialAnlys · 2026-10-16
- 14 open-source LLM observability tools to know in 2026, from Langfuse to Laminar — TheTuringPost · 2026-10-16
- Local AI is a routing problem, not a privacy feature: where each task should run — bigdata · 2026-10-16
- Moving agent work from GPUs to CPUs for durable, predictable actions — cramforce · 2026-10-16