VGGT Knows More About Its Pose Failures Than It Reports: Linear Probe Hits 93.5% AUC

zhenjun_zhao · x · 2026-10-28

Researchers ask whether frozen VGGT internally knows when its predicted camera poses are wrong. On HardMatch—1,000 difficult image pairs where VGGT fails on 35%—a linear probe on frozen features predicts failures with 93.5% ROC-AUC, beating VGGT's own point-map confidence (79.7%) and a classifier on all its outputs (77.7%). The probe catches failures VGGT is confident about, transfers without retraining to PhotoTourism and ScanNet-1500, and emerges abruptly mid-network in the cross-view fusion layers—a pattern shared by π³.

Original post →

More from Research

Research channel →