LoL lets LLMs adapt layer order per input, switching algorithms at inference

LotfiSanae · x · 2026-11-04

The LoL (Learning Order of Layers) idea lets an LLM adapt its layer execution order to each input — even learning a different layer order for each classic algorithm (Sudoku, mazes), with the order fixed at inference time to choose which algorithm the model runs. Presented in a 4-minute video and amplified by Adaption Labs co-founder Sudip Roy and scientific lead Hugo Larochelle.

Related event: Library of Layers: Transformers That Rearrange Their Own Forward Pass at Runtime(15 posts)→

Original post →

More from Research

Research channel →