Routing should use lossless, uncompressed hidden states, the post argues

ChengleiSi · x · 2026-07-21

The post argues that accurate routing should come from lossless, uncompressed hidden states.

It is a short but technical statement about how routing decisions ought to be made in model systems: preserve the full hidden representation rather than compressing away information first.

Original post →

More from Research

Research channel →