LoL maze experiments: hard-coded layer orders replicate specific search algorithms

micahgoldblum · x · 2026-11-04

Parts 5-6 of the thread: maze experiment setup — trained on mazes solved 5 ways, then hard-coding layer orders matching a single algorithm makes the model execute it >99.7% of the time.

Related event: Library of Layers: Transformers That Rearrange Their Own Forward Pass at Runtime(15 posts)→

Original post →

More from Research

Research channel →