Qwen3.8-Flash-Next-NVFP4 hits 120-361 tok/s on Quad 3090 via custom P2P driver
QuixiAI · x · 2026-09-07
QuixiAI got nvidia/Qwen3.8-Flash-Next-NVFP4 running in SlimServe on a quad RTX 3090 setup, reaching about 120 tok/s at concurrency 1 and 361.7 tok/s at concurrency 8, using a custom P2P driver (QuixiAI/open-gpu-kernel-modules).
More from Infra
- Meta researcher: horrifying infra, not talent, is why OSS can't catch closed frontier — A_K_Nain · 2026-10-23
- Jane Street and NVIDIA speed up Mamba-2 with custom cuTile kernels — blelbach · 2026-10-23
- LatentLoop: asymmetric compute allocation cuts looped-MoE training cost by 19% — pmttyji · 2026-10-23
- Same AI request emits 8.5x more CO2 in Texas than in Sweden — jlundberg · 2026-10-23
- SK Hynix Pulls Plug on Solidigm US IPO as Chip Stocks Slide, Shares Down ~30% This Quarter — rohanpaul_ai · 2026-10-23
- Designer mocks Nvidia: buy idle GPUs or lose access to new ones—definitely not a bubble — michalmalewicz · 2026-10-23