Loop transformers trained on hard discrete tasks generically produce fractals, researcher says

wgilpin0 · x · 2026-09-24

Researcher wgilpin0 clarifies his paper's contribution: the mechanism from the KSAT ODE paper is generic—training a generic loop transformer on any "hard" discrete task yields fractal structures, suggesting fractals are a property of the task rather than the model. The project was inspired by one of his favorite papers showing deep search for KSAT produces fractals when hard. He also expresses interest in deep search for combinatorial optimization, where he believes fractals are inevitable.

Original post →

Loop transformers trained on hard discrete tasks generically produce fractals, researcher says

More from Research