DeepSeek-V4-Flash on 4×AMD V620: 300K Context, 21 tok/s Generation
Thin_Pollution8843 · reddit · 2026-08-15
A user runs DeepSeek-V4-Flash-0731 IQ3XXS on 4 AMD Radeon Pro V620 GPUs (128GB VRAM) with DSpark speculative decoding. 32K prompt ingestion at 276 tok/s, short prompt at 379 tok/s, continuous generation at 21 tok/s, accepted generation at 30.6 tok/s. However, q3xxs quantization degrades quality, and VRAM is insufficient for the drafter.
More from Infra
- Drama3 TTS lands in audio.cpp: up to 5x real-time on RTX 5090, <8GB VRAM mode too — Acceptable-Cycle4645 · 2026-10-16
- Drama3 TTS lands in audio.cpp: up to 5x real-time on RTX 5090, <8GB VRAM mode too — Acceptable-Cycle4645 · 2026-10-16
- Three CoreWeave co-founders have sold $3.3B in shares since IPO amid credit worries — SumitGup · 2026-10-16
- Cherry pi on a Raspberry Pi: the tiny-model rumor developers are watching — sull · 2026-10-16
- CoreWeave's debt costs falling: DDTL spreads tightened from S+9.62% to S+2.25% — BenBajarin · 2026-10-16
- SoftBank lines up US IPOs for SB Energy and AI robotics spinoff Roze, valuations top $50B — nordicinst · 2026-10-16