Apple-π Dataset Released: Benchmarking Video Models' Physical Reasoning

ziqi_huang_ · x · 2026-08-03

Apple-π is a new law-grounded benchmark designed to evaluate whether video generation models actually reason with physical laws or merely produce plausible-looking motion.

The dataset consists of 400 videos covering 10 canonical classical-mechanics tasks (9 single-law and 1 multi-law). The evaluation is structured into three core stages:

The accompanying Orchard dataset is now fully open-sourced on Hugging Face.

Original post →

More from Research

Research channel →