Chaining DGX Spark boxes with QSFP cables for dumb data-parallel training actually works

austinvhuang · x · 2026-11-19

While DGX Spark's memory bandwidth is mediocre for n=1 interactivity, Austin Huang found that linearly scaling multiple units with QSFP cables for simple data-parallel training runs works nicely — his new bedtime ritual is kicking off exploratory continued-pretraining runs before sleep.

Related event: Linking Multiple DGX Sparks via QSFP for Data-Parallel Training(2 posts)→

Original post →

More from Infra

Infra channel →