Gordic: interpretability of looped transformers likely no harder than deep models

gordic_aleksa · x · 2026-11-22

AI researcher Aleksa Gordić argues that interpretability of looped transformers is presumably no harder than that of very deep models, and that 'one way or another we're heading in that direction' — a concise trend take from a practitioner.

Original post →

More from Research

Research channel →