PyTorch Issue: Inconsistent Randomness Across Devices with Deterministic Algorithms

rice_fry · x · 2026-08-25

A PyTorch GitHub Issue (#84234) highlights that random number generation remains inconsistent across different GPUs even when usedeterministicalgorithms is enabled.

The issue argues that as a research platform, PyTorch should support reproducible results across different devices (CPU or physical GPU) given the same seed, PyTorch version, and CUDA version. The current inconsistency hinders experiment reproducibility.

Original post →

More from coding & agent

coding & agent channel →