MIT reads and steers LLMs' internal physics intuition via hidden-state shifts in Gemma

ProfBuehlerMIT · x · 2026-11-19

MIT's Markus Buehler published new work in AI for Science showing that an LLM's representation of physical relationships can be both read and steered, with implications for post-training signals that deepen generalization of physical principles.

The method treats hidden states as measurable objects: across three sizes of Google's Gemma, the authors flipped a single physical quantity in a question (like pulling on a spring) and measured the resulting hidden-state shift. Two mathematical lenses interpret those numbers: the direct logit lens (which words the model favors at that stage) and the Jacobian lens (how sensitive downstream numbers are to small upstream changes). When describing grooves forming along crystal boundaries in steel, the Jacobian lens ranked corrosion first—although the question never named it—revealing the model's inner reasoning.

Key findings:

Implication: physical laws live inside LLMs in a human-readable, steerable form, and such post-training signals could help models build deeper generalizations of physical principles.

Related event: MIT Researchers Read and Manipulate LLMs' Internal Physics Intuition(2 posts)→

Original post →

More from Research

Research channel →