A 10-item beginner reading list for LLM distributed training, from Horovod to FSDP

East-Muffin-6472 · reddit · 2026-11-17

The author shares a 10-item reading list in the exact order they learned LLM distributed training from scratch, aimed at engineers on small multi-node clusters:

Hosted as a curated shelf on papercase.dev with community-driven rebalancing of the reading order.

Original post →

More from Infra

Infra channel →