Noise speedrun: no-backprop pretraining gets 4,000x faster in ten days

Crazy-Repeat-2006 · reddit · 2026-10-23

qlabs launched Noise, a pretraining speedrun where model, data, and scoring are fixed, but learning algorithms must never run a backward pass. Two tracks compete on how low the loss can go and how fast. Their Dust baseline scores 4.167.

Within ten days, community submissions made the speedrun over 4,000x faster: time to reach validation loss 4.2 without backprop fell from 1.76 hours to 1.6 seconds. The team had estimated another 1,000x speedup over Dust was possible—community blew past it in ten days.

Related event: Backprop-free pretraining 4000x faster in 10 days, but doubts raised(6 posts)→

Original post →

More from coding & agent

coding & agent channel →