Researcher argues fp32 or stochastic rounding for main weights is long-established practice

y0b1byte · x · 2026-11-18

In a reply to Google DeepMind researchers giffmana and mwulfmeier, y0b1byte argues that keeping main weights in fp32 or using stochastic rounding is a well-established convention across domains, responding to a discussion thread on numerical precision in training.

Original post →

More from Research

Research channel →