Preprint: Gemma 3 12B builds a spatial map internally but never uses it

IndraVahan · x · 2026-11-13

A preprint making the rounds claims Gemma 3 12B internally constructs a spatial map and even represents it, yet never uses that map to answer questions. When forced to rely on the map, the model's accuracy improves — raising the question of why it didn't use it in the first place.

Related event: Gemma 3 12B Builds Internal Spatial Maps but Ignores Them(2 posts)→

Original post →

More from Models

Models channel →