A mech-interpretability article argues transformers and neurons both use cyclic arithmetic

burny_tech · x · 2026-07-25

A shared article connects mechanistic interpretability with neuroscience and argues they have more in common than they first appear.

The author says that after 10+ years in systems neuroscience, they can now post about how transformers compute like real neurons.
The article’s favorite example is that both systems use cyclic representations for arithmetic.
The thread frames the piece as a cross-disciplinary look at how neural computation and transformer internals may share underlying representational patterns.

More from Research