Video AI agent runs a physics engine, then paints your real room over the blocks

jonstephens85 · x · 2026-10-27

A video AI agent pipeline unfolds in steps: it assigns physical properties to every object (an apple weighs 0.2kg, a monitor 4.2kg, each with friction), then a physics engine plays out the requested actions—open the drawer, throw the apple, drop in a robot. Since the underlying box world looks like flat colored blocks, a video model finally "paints" it into a realistic video of your actual room, using your original photos as reference.

Related event: World Model Approach: Assign Physical Properties, Let Physics Engine Simulate(2 posts)→

Original post →

More from Embodied

Embodied channel →