antirez streams a half-trillion-param DeepSeek v4.1 Flash on one DGX Spark at ~9 t/s
antirez · x · 2026-09-14
antirez demonstrated running DeepSeek v4.1 Flash (half a trillion parameters) on a single DGX Spark via SSD streaming: 9 t/s generation, or 22 t/s with dual-Spark RDMA. He calls it "kinda usable for QA" but not for coding unless left running overnight. The support landed in his DwarfStar project.
Related event: antirez Runs 500B-Param DeepSeek on a Single DGX Spark via SSD Streaming(3 posts)→
More from Infra
- Aristotle system machine-checks Ibex RISC-V core MUL operation formally — satnam6502 · 2026-10-31
- Clover-35B-A3B Quantized to 29.4 GB Runs at ~42 tok/s on a 64 GB Mac — viveky259 · 2026-10-31
- Liquid Agent brings fully local LFM3 agent to Linux with one-command install — JosephJacks_ · 2026-10-31
- A fully local office AI stack: MiniCPM, Qwen3, LFM2.5 and Whisper — HowDevelop · 2026-10-31
- a16z: GPU rental prices up 106% in 3 months while token prices fall 58% — a16z · 2026-10-31
- vLLM nightly adds PLE disk offload, with a telling [Qwen4Exp] tag on the PR — rmhubbert · 2026-10-31