Recovering 4.1 GiB of hidden RAM on NVIDIA DGX Spark with a 64 KiB kernel
marian_nmt · x · 2026-10-02
Marcin Junczys-Dowmunt published a full write-up, source code, and runbook for reclaiming 4.1 GiB of RAM that Linux hides from the NVIDIA DGX Spark's 128 GB unified memory. Two stacked tricks: (1) installing NVIDIA's official 64 KiB kernel cuts vmemmap struct page metadata by 16x, recovering 2.098 GiB (the 4 KiB kernel can be kept as a GRUB fallback); (2) reclaiming the 2,046 MiB display reservation on a headless GB10 adds another 2,046 MiB. Combined, this grows a GLM-5.3-Flash KV pool from 262,144 to 937,984 tokens (3.58x) per host. He notes prior community work covered each method separately, but not together.
Related event: Reclaiming 4.1 GiB of hidden memory on NVIDIA DGX Spark(7 posts)→
More from Infra
- AMD Loom boosts Qwen3.5-4B prefill up to 2.6x on Radeon 890M laptops — jfowers_amd · 2026-11-19
- Dev submits PR adding periodic checkpoints to GKE sandboxes so agents don't lose progress — yoimnotkesku · 2026-11-19
- AWS Lambda Adds GPU Support via Managed Instances for Inference and Media Workloads — DavidWells · 2026-11-19
- Nvidia Allegedly Made GPUs Artificially Scarce to Keep Prices Sky-High — GaryMarcus · 2026-11-19
- AWS adds private CA support to Bedrock AgentCore Identity for connecting agents to self-hosted IdPs — AWS ML Blog · 2026-11-19
- Leak Hints at Classified 1M-GPU Training Cluster in China That Skips HBM — teortaxesTex · 2026-11-19