Hyper-Connections debate: mHC slightly beats iHC, xHC gains unclear
YouJiacheng · x · 2026-11-05
In a brief X exchange, YouJiacheng weighs in on the Hyper-Connections family of architectures: LDM's outer-product variant is essentially iHC (possibly just a different parameterization), mHC appears to modestly outperform iHC, while xHC's short-conv approach shows unclear gains.
More from Research
- Talk recording out for Representation-Space MMD for Diffusion Language Models paper — LucaAmb · 2026-11-05
- HyperQ adds trainable quantum residual branches to a frozen 1.1B diffusion LM — jiqizhixin · 2026-11-05
- Open-source PageIndex ditches vectors for tree-search RAG, scores 98.7% on FinanceBench vs GPT-4o's 31% — aakashgupta · 2026-11-05
- Andriy Burkov releases 'The Hundred-Page Language Models Book', a hands-on PyTorch guide — burkov · 2026-11-05
- Blogger proposes scrapping ML conference checklists now that everyone uses LLMs to vet papers — bremen79 · 2026-11-05
- Agent harnesses aren't dying: harness distillation changes the job, says O'Reilly — bibryam · 2026-11-05