Running a 510GB DeepSeek model on a 128GB DGX Spark by pruning unused MoE experts
pbaylies · x · 2026-09-14
@0xBakeer demonstrates running the 510GB DeepSeek-V4.1-Flash with 256k context and thinking mode on a single 128GB DGX Spark — no smaller model, no cloud.
The trick exploits MoE sparsity: each token activates only 6 of 384 experts, so he pre-selects which experts the target job needs and loads only those.
Related event: Devs Squeeze Giant DeepSeek Model onto Consumer Hardware(2 posts)→
More from Infra
- Your AI agent would cost 260% more without prompt caching, Arena data shows — arena · 2026-10-30
- Nebius runs auction-driven GPU pricing, lifting rates ~20% amid tight supply to 2028 — BenBajarin · 2026-10-30
- macOS update silently re-adds eMudhra root certs users had removed — steipete · 2026-10-30
- Bittensor's Terza Inference routes one API across miners' models on subnet 103 — const_reborn · 2026-10-30
- SGLang Summit 2026 sells out sponsor booths and Full Passes ahead of Nov 12–13 event — ying11231 · 2026-10-30
- OpenRouter rebuilds provider routing: 46% fewer capacity errors, 16.9% faster TTFT — steipete · 2026-10-30