SGLang runs Inkling 2 Mini in 65GB on DGX Spark, 2x faster prefill than vLLM

AIFlow_ML · x · 2026-11-22

Benchmarks on a DGX Spark show SGLang serving Inkling 2 Mini in just 65GB of unified memory vs 105GB for vLLM, with 15.6k-token prompt prefill at 4.48s vs 9.23s. The 40GB headroom leaves room to run agents and tools alongside the model.

Original post →

More from Infra

Infra channel →