New research lets models compose their own computational graphs

micahgoldblum · x · 2026-11-04

A new paper (code released) takes a first step toward models that compose their own computational graphs via routing interventions. Open questions: can such interventions steer behaviors like deception in chat models, and can models run deeper at test time than in training for more latent reasoning?

Related event: Library of Layers: Transformers That Rearrange Their Own Forward Pass at Runtime(14 posts)→

Original post →

More from Models

Models channel →