YOCO architecture expands with a Sparse Attention variant, becoming an architecture family
donglixp · x · 2026-09-11
The YOCO (You Only Cache Once) architecture is expanding beyond its looped variant with a new YOCO + Sparse Attention branch, evolving "from looping to sparsity" into a broader architecture family, per author donglixp. Links to both the Looped YOCO stack and the new sparse attention work are shared.
Related event: Microsoft's Universal YOCO enables efficient depth scaling(3 posts)→
More from Research
- EMNLP Oral: training-free Nexus Sampling cuts KV-cache memory 10x; OpenResearcher tops BrowseComp-Plus at 54.8% — yuz9yuz · 2026-10-27
- ICML 2026 position paper: LLM 'thinking traces' are a harmful anthropomorphism — rao2z · 2026-10-27
- Forking gap follows a power law in context frequency; masking rare n-grams shrinks it — ZimingLiu11 · 2026-10-27
- How forking happens: n-gram tables split logits into non-interacting subspaces — ZimingLiu11 · 2026-10-27
- The best LoRA explainer video yet: rank constraints meet intrinsic dimension — sophiamyang · 2026-10-27
- No π0 weights changed: Motoniq layer lifts real-robot precision fitting from 0/10 to 9/10 — hbouammar · 2026-10-27