Latent Lattice Language Models propose adding a horizontal axis of computation to the Transformer residual stream

burny_tech · x · 2026-11-19

@ShivamDuggal4 introduces Latent Lattice Language Models (LLLMs): today's LMs process each token through a single residual stream—reading/writing memory and applying MLPs layer by layer before decoding the next token. LLLMs augment this vertical stream with a horizontal axis of computation, the Lattice of Latents, asking whether this single-stream computation can be scaled up. The work is framed as bridging RNNs and Transformers; @ellisbrown's repost signals early community attention.

Related event: MIT and Adobe Propose Latent Lattice Language Models(3 posts)→

Original post →

More from Research

Research channel →