Goodfire probes Inkling 2 Mini: looped model layers read from "future" layers

fatihdin4en · x · 2026-11-21

After Thinking Machines released Inkling 2 Mini, a 26B looped transformer, interpretability firm Goodfire got early weight access and studied how information flows through blocks and loops. Counterintuitively, looped layers can write to themselves or read from "future" layers; decomposing per-layer inputs reveals which layers, blocks, and loops communicate. Goodfire argues our ability to understand transformers can evolve alongside their architectures.

Original post →

More from Models

Models channel →