DeepSeek v4.1 Flash runs out of the box on six NVIDIA GPUs via vLLM on day 0, AMD lags
woosuk_k · x · 2026-09-12
SemiAnalysis reports that on the Day 0 release of DeepSeek v4.1 Flash, NVIDIA vLLM works with zero issues across all six GPU SKUs: H100, H200, B200, B300, GB200, and GB300, crediting the NVIDIA and Inferact teams. By contrast, AMD's vLLM support still fails on the model, a gap the thread promises to detail. The takeaway: day-0 compatibility with top inference stacks is now table stakes, and AMD's ecosystem remains the laggard.
More from Infra
- AI spending spree deepens free cash flow holes; Microsoft stays positive via $25B bond offering — Kr00ney · 2026-10-31
- Google Cloud spend caps go GA with API, live cost reports and automatic monthly resets — rseroter · 2026-10-31
- Swift 1.5 Flash Next Heretic quants add IQ4_XS and IQ3_S tuned for reverse engineering — jjusko20 · 2026-10-31
- ClickHouse discloses unauthenticated RCE vulnerability CVE-2026-116366, patches available — Hacubu · 2026-10-31
- Count document passes, not tokens: batching questions cuts LLM scoring cost — petrusenko_max · 2026-10-31
- Budget dual-RTX 3060 12GB local inference rig beats a 5060 16GB setup on VRAM per dollar — Frizzy-MacDrizzle · 2026-10-31