Apparent Qwen4 pretraining loss curve leaks: smooth run down to ~1.03 with no spikes
AM09_21 · x · 2026-11-16
A curve labeled as Qwen4 pretraining shows training loss falling smoothly from 1.80 to about 1.03 over the full run with almost no spikes, prompting the poster to marvel at how stable frontier pretraining has become. Unofficial, treat as a rumor.
More from Infra
- Microsoft's USB4 RDMA lets mini PCs pool memory to run Qwen3-235B — JFPuget · 2026-11-22
- LTX 2.5 keeps crashing on AMD 9070 XT with driver timeouts while MiniMax H3 runs fine — ZestycloseReading504 · 2026-11-22
- FT: AI server suppliers raise prices up to 45% months after deals are signed — nordicinst · 2026-11-22
- China Installed 59% of New Industrial Robots in 2026 Report, ~354,000 Units — ingliguori · 2026-11-22
- MLX over Vulkan hits 124 tok/s on RTX 5060 Ti, beating llama.cpp CUDA by 25% — SumitGup · 2026-11-22
- Intruder swapped Prime Intellect's hosted DeepSeek for an abliterated copy for 53 hours — mawcopolow · 2026-11-22