DINOv3 patches strongly encode position by default — you should clean them up

StephanSturges · x · 2026-11-22

The author observes that DINOv3 patch features encode positional information to a staggering degree by default — PCA visualizations show smooth position gradient patterns (second column). This may help on some benchmark tasks in papers but isn't great for real-world usage; the features need to be cleaned up before deployment, with before/after visualizations provided.

Related event: DINOv3 patch features encode strong positional information(2 posts)→

Original post →

More from Research

Research channel →