xHC Architecture: Expanding Transformer Residual Streams into Parallel Flows

A new paper introduces xHC (Expanded Hyper-Connections), a novel architecture that expands the Transformer's residual stream into N parallel flows to significantly enhance model capacity and expressiveness.

2026-07-17 ~ 2026-07-18 · 2 related posts

• xHC: Scaling Residual Streams by 16x — teortaxesTex · 2026-07-17
• xHC: New Paper on Expanding Residual Streams — burny_tech · 2026-07-18