Distillation is mostly cope: labs buy astronomical data, dev argues overhyped in local AI community

gnukeith · x · 2026-11-23

Developer gnukeith pushed back on the local AI community's obsession with distillation: open-weight labs don't spend their days distilling rival models. He cites Thinking Machines as having some of the highest-quality training data, and says his privacy-space experience shows freely available and purchasable data exists at astronomical scale.

He claims xAI bought Cursor for its data and Grok improved significantly afterward (unverified). His take: distillation's importance is mostly cope, and labs will be fine without it — though he adds that distilling from closed labs is morally justified since those labs trained on scraped data.

Original post →

More from Models

Models channel →