GLM 5.3 flash on dual DGX Sparks gets 50-90% decode boost with new open recipe
swiebertjee · reddit · 2026-10-05
A Redditor reports that a new open NVFP4 recipe (GLM-5.3-Flash-NVFP4-DFlash2-2x-DGX-Spark) boosts GLM 5.3 flash decode by 50-90% on dual DGX Sparks:
- Quality benchmarks up 3-13% across B2 categories (prose +13%, bulk SQL INSERT +10%); prefill drops 10-21% as the tradeoff
- Decode now beats DeepSeek v4.0 flash; the newer v4.1 doesn't run on dual Sparks at all
- 40-minute soak: 503 requests, 0 errors, KV pool memory down 72%; the old repetition bug is fixed
- Author ran it for days on coding, devops, and vision tasks and rates it near Claude Opus 4.8 level
The recipe is open on GitHub — a solid empirical reference for local LLM deployment.
More from Infra
- Ex-Waymo exec Abe Murray: CUDA and ISAs won't stay moats, huge chip innovation incoming — IgorCarron · 2026-11-20
- MIT and NVIDIA's QDA uses agents to auto-design LLM quantization recipes, beating top public ones by up to 2.2 points — omarsar0 · 2026-11-20
- Caixin: US remote-access cutoff and Nvidia CEO exit leave China's tech giants halting overseas compute deals — Gregory_C_Allen · 2026-11-20
- QuixiInfer: Rust Engine Runs 125B MoE Model on a Single RTX 5090 — QuixiAI · 2026-11-20
- QuixiInfer: from-scratch Rust engine runs DeepSeek with 256k context on a single RTX 5090 at ~30 tok/s — QuixiAI · 2026-11-20
- AMD's Lisa Su: data center to hit ~80% of revenue by 2027, sees $220B server CPU market — AccBalanced · 2026-11-20