'Don't train on model outputs' is unenforceable when the data is all over the open web

anpaure · x · 2026-11-22

A back-and-forth on training-data contamination: xeophon argues a 'don't train on XY model outputs' rule is literally impossible to enforce since such data is everywhere on the open web; anpaure counters that Chinese-model-generated content is a negligible share of any sample (0.0001% of users) and says the real question is how to detect poisoned data.

Original post →

More from Models

Models channel →