Counterintuitive: generic synthetic data beats model-generated data for distillation

Developer ostris found that distilling an adapter for the Ming Image model with generic synthetic data outperformed training on model-generated data, challenging a common assumption in distillation training.

2026-09-24 ~ 2026-09-24 · 2 related posts

• Counterintuitive: generic synthetic data beats self-generated data for distillation adapters — ostrisai · 2026-09-24
• Counterintuitive distillation finding: generic synthetic data beats model-generated data for adapters — ostrisai · 2026-09-24