LeHami brings Hamiltonian mechanics into JEPA with symplectic integrators to prevent latent collapse
TheTuringPost · x · 2026-11-07
- The Turing Post breaks down LeHami, by Yann LeCun, Randall Balestriero, and Romina Yalov: injecting Hamiltonian mechanics into JEPA world models to preserve phase-space volume and prevent latent collapse during long-term predictions.
- Why Hamiltonian over Lagrangian: variables are coordinates q and momenta p, yielding paired first-order update equations. The Hamiltonian H (typically kinetic + potential energy) is the central function, learned with kinetic-like K(p) and potential-like V(q, u) components, where u represents actions.
- A symplectic leapfrog integrator predicts state evolution under actions while preserving constraints. The accompanying chart contrasts the two equivalent formulations and notes LeHami rules out specific rollout-collapse modes, not prediction errors.
More from Research
- Stories about a generic AI beat self-referential stories, challenging the Persona Selection Model — repligate · 2026-11-08
- Kundaje: Even After Validation, Delivering AAV/CRISPR to Causal Cell Types Remains Unsolved — anshulkundaje · 2026-11-07
- Stanford Prof: Once LLMs Can Act on Noncoding Variants, Validation Becomes the Bottleneck — anshulkundaje · 2026-11-07
- New blog: how your RL judge and credit assignment shape model reasoning quality — tokenbender · 2026-11-07
- Team Lands 3rd Place in Both Kaggle ARC AGI Competitions, Publishes Solution Writeup — GregKamradt · 2026-11-07
- AI won't crack rare diseases' #1 bottleneck: uncharacterized causal mechanisms — anshulkundaje · 2026-11-07