Paper: Transformers converge to invariant algorithmic cores across training runs

pickover · x · 2026-11-20

A new paper by Joshua S. Schiffman argues training selects for behavior, not circuitry — many weight configurations implement the same function, so studying a single trained network risks describing accidents of one run. It introduces Algorithmic Core Extraction (ACE) to isolate compact subspaces necessary and sufficient for a task, recurring across independently trained models, with causal validation:

Related event: Paper: Transformers Converge to Invariant Algorithmic Cores Across Models(2 posts)→

Original post →

More from Research

Research channel →