Apparent Qwen4 pretraining loss curve leaks: smooth run down to ~1.03 with no spikes

AM09_21 · x · 2026-11-16

A curve labeled as Qwen4 pretraining shows training loss falling smoothly from 1.80 to about 1.03 over the full run with almost no spikes, prompting the poster to marvel at how stable frontier pretraining has become. Unofficial, treat as a rumor.

Original post →

More from Infra

Infra channel →