'Neural twins' that talk in neuralese compared to mixture-of-transformers architectures

torchcompiled · x · 2026-10-30

Reacting to the 'neural twins' announcement — models trained for each other that communicate entirely in neuralese — torchcompiled notes it's a promising way to combine multiple models, but architecturally closer to mixture-of-transformers, the common pattern in multimodal diffusion models jointly attending across modalities. The exchange offers a useful architectural framing for this new model-to-model communication paradigm.

Original post →

More from Multimodal

Multimodal channel →