Researcher: anti-distillation claims rest on weak evidence, CoT distillation may be unstoppable

adam_karvonen · x · 2026-11-22

Adam Karvonen pushes back on an anti-distillation blog post, arguing its evidence that distillation can actually be prevented is weak for typical product use cases — and that similar posts put little effort into tuning the no-CoT-distillation baseline. With modest improvements to distillation training (e.g. synthesizing a CoT for a given output), distillation may be practically impossible to stop.

Related event: Researcher Questions OpenAI's Anti-Distillation Claims(4 posts)→

Original post →

More from Models

Models channel →