Reclaiming 4.1 GiB of hidden memory on NVIDIA DGX Spark

Marcin Junczys-Dowmunt published a hands-on tutorial showing that although the NVIDIA DGX Spark advertises 128GB of unified memory, Linux leaves 4.1 GiB of it unexposed by default. Using two stackable tricks he recovered the full hidden memory, growing the KV pool from 262k to 938k tokens (3.6x) in benchmarks, and open-sourced a minimal repo, emjotde/spark-ram-reclaim, for reproduction.

Confirmed

Why it matters

2026-10-02 ~ 2026-10-02 · 7 related posts

Primary sources

4 near-duplicate retellings: marian_nmt · marian_nmt · marian_nmt · marian_nmt