NeurIPS paper: video diffusion models encode physics internally even when outputs are wrong

katjahofmann · x · 2026-10-13

The NeurIPS Spotlight paper "The Invisible Hand of Physics" asks whether video diffusion models (VDMs) encode physics internally even when their generated samples get it wrong. Answer: they do—and on average their internal physics understanding beats V-JEPA 2. The result suggests generation errors don't mean the model lacks physical intuition; advised by Meta's Katja Hofmann and others.

Original post →

More from Multimodal

Multimodal channel →