DINOv3 patches encode position so strongly by default that you need to clean them up

StephanSturges · x · 2026-11-22

The author observes that DINOv3's patch features encode position to a staggering degree by default—likely inflating benchmark performance on some paper tasks but problematic for real-world usage. Accompanying PCA visualizations of aerial imagery show position gradients dominating the feature maps. The takeaway: clean the patches up before deploying them downstream.

Related event: DINOv3 patch features encode strong positional information(2 posts)→

Original post →

More from Models

Models channel →