antirez streams a half-trillion-param DeepSeek v4.1 Flash on one DGX Spark at ~9 t/s
antirez · x · 2026-09-14
antirez demonstrated running DeepSeek v4.1 Flash (half a trillion parameters) on a single DGX Spark via SSD streaming: 9 t/s generation, or 22 t/s with dual-Spark RDMA. He calls it "kinda usable for QA" but not for coding unless left running overnight. The support landed in his DwarfStar project.
Related event: antirez Runs 500B-Param DeepSeek on a Single DGX Spark via SSD Streaming(3 posts)→
More from Infra
- Chart shows hyperscalers went on a CAPEX spree after DeepSeek — and Kimi broke the logic — StewartalsopIII · 2026-09-14
- Free My VRAM: open-source tool auto-unloads idle ComfyUI models, 29.8GB to 0.8GB — WazaqG · 2026-09-14
- Nvidia Partners With Palantir to Chase the $500 Billion Sovereign AI Market — Beth_Kindig · 2026-09-14
- Meme Post Roasts Every Local LLM Camp: Apple, AMD, Nvidia and Offload Users — Saren-WTAKO · 2026-09-14
- No.2 US law firm Latham & Watkins buys Nvidia servers to fine-tune open models in-house — ai · 2026-09-14
- Andrew Chen's homelab for local AI: 5090 eGPU, dual DGX Spark and a routing plugin — andrewchen · 2026-09-14