Data curation RL is just SWE envs: code pretraining data increasingly consists of Claude-built, less-sloppy repos

willcb · x · 2026-11-14

Following up on his own thread, willcb notes that "data curation RL" in this context is essentially SWE environments: the so-called "code pretraining data" is increasingly made of progressively less-sloppy repos built by Claude. In other words, next-gen pretraining corpora are being reshaped — and cleaned — by prior-generation models, turning data curation itself into an agent workload.

Original post →

More from coding & agent

coding & agent channel →