How Many Users Can One DGX Spark Realistically Serve? Community Asks for Numbers
edge_compute_user · reddit · 2026-08-27
A Reddit user is collecting real-world data on serving multiple users from a single NVIDIA DGX Spark: what's the highest realistic concurrent user count?
Requested details include model + quantization, peak concurrent users, context/request length, tokens/sec per user, and use case — useful reference for teams considering small self-hosted inference on DGX Spark.
More from Infra
- GPU Cloud Showdown: RunPod vs. Vast vs. Nebius and the Env Fragmentation Tax — big-in-jap · 2026-08-27
- Data centers are 'intelligence factories': Energy is the fuel of the new industrial age — NinaDSchick · 2026-08-27
- Integrating Warp Factory run costs into Slack for model routing optimization — vikvang1 · 2026-08-27
- Cloudflare Workers testing granular permissions for agents — dinasaur_404 · 2026-08-27
- Weaviate 1.39 ships Boost API and MMR to GA, adds 4-bit RQ quantization — CShorten30 · 2026-08-27
- Phala Confidential AI bills 61.5B tokens in 24h, DeepSeek leads at 54% — bgmshana · 2026-08-27