Pretraining as Digital Enclosure: The Missing Post-Training Data Commons
David Hall (dlwh) argued that pretraining benefited from an inadvertent digital commons while post-training consumes tasks, for which no commons exists and must be deliberately built; he conceded pretraining was akin to enclosure of millions' knowledge, while Blanche Minerva contested his proposed commons model.
2026-10-15 ~ 2026-10-16 · 4 related posts
- There is no posttraining data commons: open models' next data bottleneck — dlwh · 2026-10-15
- Where will next-gen open model data come from? Task commons doesn't exist yet — NeelRajani_ · 2026-10-16
- dlwah likens pretraining to the enclosure movement, hopes for a deliberate posttraining commons — dlwh · 2026-10-16
- Blanche Minerva pushes back on 'posttraining commons': scraped data wasn't a commons — BlancheMinerva · 2026-10-16