Dev Shares vLLM Recipe for Qwen3.8 Flash Next NVFP4 on RTX Pro 5000

With no official deployment recipe available, a developer built a custom vLLM setup based on Hermes and Unsloth 4-bit quantization to run Qwen3.8 Flash Next NVFP4 on an RTX Pro 5000 72GB.

2026-09-26 ~ 2026-09-26 · 2 related posts

• vLLM recipe for Qwen3.8 Flash Next NVFP4 with TP=2 on RTX Pro 5000 72GB — knob-0u812 · 2026-09-26

1 near-duplicate retellings: knob-0u812