NVIDIA's PhyProbe scores physical consistency of AI-generated videos, beating prior evaluators

nvidia · hf · 2026-10-14

NVIDIA, University of Waterloo, and Vector Institute introduce PhyProbe, an evaluator that maps features from a frozen spatio-temporal encoder to a scalar physical-consistency violation score via a lightweight head, trained with a unified objective combining pairwise ranking, regression on noisy annotations, and anchor-based calibration. It outperforms prior evaluators on most pairwise benchmarks, with the largest gains in no-correspondence and generated-generated settings where fine-tuned evaluators degrade sharply, correlates strongly with human judgments on a stable [0,1] scale, and remains competitive on human preference benchmarks despite never training on general preference labels.

Original post →

More from Multimodal

Multimodal channel →