Can 4 DGX Sparks Run Ling-3.1-flash? Redditor Weighs 560B-A25B MoE at Home
BerryBlush_Rogers691 · reddit · 2026-10-14
Ant Ling's Ling-3.1-flash — shown turning rough briefs into UIs and interactive prototypes — is now on Hugging Face (inclusionAI/Ling-3.1-flash) with 560B total parameters and 25B active per token (MoE).
- Official examples use 8× H200 or 4× GB300; the poster wants to know if 4 DGX Sparks could work.
- Use case: coding and iterative UI work where single-user latency matters more than batch throughput.
- Open questions: which quantization leaves room for context and runtime overhead, which serving stack splits it across four Sparks, and whether latency stays usable during tool calls and long-context reads.
The thread solicits real prefill/decode numbers from anyone running large MoEs across Sparks.
More from Infra
- MiniCPM-V 4.7 runs a 35B MoE multimodal model on phones with just 3GB memory — nevrekaraishwa2 · 2026-10-15
- Nvidia Is Now Worth More Than the Entire Indian Stock Market — theteknosaur · 2026-10-15
- NVIDIA joins EU's AI in Science Enablers, offering compute, training and cloud resources — nordicinst · 2026-10-15
- Open source's hardware trap: data centers crowd out consumer GPUs, local LLMs become a privilege — Dante_77A · 2026-10-15
- NVIDIA backs EU AI in Science push as 35 supercomputers to serve 3M researchers — NVIDIA Blog · 2026-10-15
- Jensen Huang: 2027 AI bottleneck is 35GW of power, revenue justifies the capex — BG2 Pod · 2026-10-15