Explaining DP, TP and PP Parallelism in One Picture
Community posts explain the three common GPU parallelism strategies—data, tensor, and pipeline parallelism—with simple diagrams, including where pipeline bubbles come from.
2026-11-19 ~ 2026-11-19 · 2 related posts
- One diagram explains data vs tensor vs pipeline parallelism, plus UvA tutorial — SeunghyunSEO7 · 2026-11-19
- PP vs DP vs TP explained: how weights and batches split across GPUs, and where bubbles come from — SeunghyunSEO7 · 2026-11-19