Why tensor parallelism breaks RNG reproducibility in model init
2026-11-17 ~ 2026-11-17 · 2 related posts
- Why tensor parallelism breaks RNG reproducibility in model init — ezyang · 2026-11-17
- Philox RNG-to-tensor assignment is extremely sensitive to hardware details — ezyang · 2026-11-17