DeepSeek-V3-Flash Runs at 47 tok/s on a Single $47 Setup

A GitHub project demonstrates running DeepSeek-V3-Flash on a single DGX Spark device with pruning and EXL3 quantization, achieving 47 tok/s generation and 400K context for about $47.

2026-08-21 ~ 2026-08-23 · 2 related posts