Recovering 4.1 GiB of RAM on NVIDIA DGX Spark: KV pool jumps from 262k to 938k tokens
marian_nmt · x · 2026-10-02
Marcin Junczys-Dowmunt's full write-up: DGX Spark ships 128 GB unified memory but Linux exposes less. Installing NVIDIA's official 64 KiB kernel (+2.098 GiB, keeping the 4 KiB kernel as GRUB fallback) plus reclaiming the 2046 MiB headless display reservation yields 4.096 GiB total, growing a GLM-5.3-Flash KV pool from 262,144 to 937,984 tokens (3.58x). Includes install commands, before/after MemTotal numbers, and the emjotde/spark-ram-reclaim repo.
Related event: Reclaiming 4.1 GiB of hidden memory on NVIDIA DGX Spark(7 posts)→
More from Infra
- Investor: market hates uncertainty more than money after Nvidia earnings — MartinGTobias · 2026-11-19
- Microsoft and Intel deepen Azure collaboration: EMIB packaging, Diamond Rapids Xeons, 2.3x CXL gains — ryanshrout · 2026-11-19
- SGLang ships Day-0 serving support for new model DaisyRose-27B — ying11231 · 2026-11-19
- Linux LTS patch flood: 3318 patches for 6.6 alone, 'no way humans are reviewing this' — pkqzy888 · 2026-11-19
- DaisyRose-27B's in-house sandbox: ~80% cheaper than cloud providers, 99.95% success rate — BanghuaZ · 2026-11-19
- Tencent's 220B Hy4-flash quantized to 49 GB weights, runnable on 64 GB VRAM — gladkos · 2026-11-19