Qwen 3.8 27B NVFP4 benchmarked on 2xV100 with ~400k context
jjusko20 · reddit · 2026-09-17
A Reddit user benchmarks the NVFP4-quantized Qwen 3.8 27B on 2x V100 32GB with NVLink, using dflash2 to reach roughly 400k total context, with a screenshot of results. Useful reference for running long-context local inference on older GPUs.
More from Infra
- OpenRouter crosses 10 quadrillion annualized token run rate, doubling every 10.5 weeks — deedydas · 2026-11-02
- Palmer Luckey asks: can you use datacenter RAM for things prohibited by the operator's terms of service? — avaitopiper · 2026-11-02
- Disable MTP for 20-30% faster local LLM inference on limited RAM — InternalMode8159 · 2026-11-02
- Kioxia up 216% in a year but down 68% from its June 2026 peak — zephyr_z9 · 2026-11-02
- Intel plunges 29%, worst day since the 1970s, wiping $12B off US government stake — emmanuelvivier · 2026-11-02
- Researcher hoards nearly 1TB of DRAM, refuses to sell a stick to data centers — kevinnbass · 2026-11-02