Building camera-motion measurement to diagnose open world model failures: measure before training

PrateekVJoshi · x · 2026-11-21

When post-training open world models, reliably measuring instruction-following and world consistency is critical. The author built a system that estimates camera motion from generated videos to locate failure modes.

Key findings: some failures don't require more training — a prompt rewrite improved spatial placement, flipping a video reversed the apparent camera orbit (with limitations), and enabling built-in retrieval improved scene consistency.

But none fully solves the underlying problems; the core argument is that measurement should come first.

Original post →

More from Models

Models channel →