Google Gemma study says physical knowledge lives in transformations between states

ProfBuehlerMIT · x · 2026-07-23

A new study using Google’s Gemma model argues that a model’s physical knowledge is stored not as static states, but in the controlled relationships between states—more like a transformation than a point.

The post links to the code, data/weights, and paper, and says the idea was inspired by mechanics.

Related event: Physics Knowledge in LLMs Lies in Hidden State Transformations(2 posts)→

Original post →

More from Research

Research channel →