Principia benchmark: video models score 0.8 on VBench but under 0.42 on physics consistency
CSProfKGD · x · 2026-09-07
Researchers from IISc and Johns Hopkins introduce Principia, a benchmark testing whether video generation models understand high school physics via relational tests.
- Core idea: absolute motion measurements depend on frame rate, scale, and camera calibration, so Principia instead checks physical relationships between paired objects obeying the same law — calibration-independent by design.
- Coverage: eight phenomena (gravity, restitution, friction, rotational inertia, projectile motion, momentum, pendulum, mass-spring oscillation) across 500+ real controlled scenes.
- Results: five state-of-the-art video generators all score 0.8 on VBench yet none exceeds 0.42 on Principia — photorealistic motion doesn't mean physically correct motion.
- VLMs struggle too: the best vision-language model detects relational physics violations at only 67% accuracy; most perform near chance.
Paper and benchmark page are public, highlighting a large gap between visual realism and physical understanding in video generation.
Related event: Principia Benchmark Exposes Video Models' Poor Physics Understanding(3 posts)→
More from Multimodal
- Two Midjourney sref codes for grainy pastel fashion illustration style — sergeantsref · 2026-10-23
- Three free ways to try MOSS-Image: API playground, HF Space, ComfyUI — songguoxiansen · 2026-10-23
- Open-source MOSS-Image tops 1M ComfyUI downloads, 5B model rivals closed rivals — songguoxiansen · 2026-10-23
- GAFU Uses Generation-Side Representations to Boost Fine-Grained Visual Understanding in Unified Multimodal Models — Tengju Ru · 2026-10-23
- MiniMax Design MCP goes live: create with Design inside Codex and other agents — Hailuo_AI · 2026-10-23
- Quiver's detailed SVG generation sparks debate: code-drawn images could replace pixel-based image models — stuffyokodraws · 2026-10-23