DINOv3 patch features encode strong positional information
Researchers found that DINOv3 patch features encode surprisingly strong positional information by default, which may inflate benchmark results but hurt real-world use; they recommend stripping or normalizing positional signals before use.
2026-11-22 ~ 2026-11-22 · 2 related posts
- DINOv3 patches encode position so strongly by default that you need to clean them up — StephanSturges · 2026-11-22
- DINOv3 patches strongly encode position by default — you should clean them up — StephanSturges · 2026-11-22