8% pretraining and 20% RL speedup from native 4-bit NVFP4 training, screenshots show

snowclipsed · x · 2026-11-14

The author shares a screenshot quantifying the gains of the NVFP4 recipe: about an 8% wall-clock pretraining speedup and a 20% RL speedup over full MXFP8 training in the largest jobs, with no calibration needed when the quantized checkpoint ships. They also ask whether the experts use MXFP8.

Related event: Thinking Machines Details End-to-End Native 4-Bit Training for Inkling 2 Small(7 posts)→

Original post →

More from Infra

Infra channel →