4×RTX 3090 Benchmark Reveals Qwen MoE Decoding Depends on Expert Hit Rate
A Reddit user benchmarked quantized Qwen MoE models on 4×RTX 3090 without NVLink, finding that expert hit rate is the key factor determining decoding speed, along with PCIe bandwidth constraints.
2026-11-13 ~ 2026-11-13 · 2 related posts
- Benchmarking a Qwen MoE on 4×RTX 3090: expert hit rate drives decode speed — maxigs0 · 2026-11-13
1 near-duplicate retellings: maxigs0