Meta's LION uses a sparse memory layer to fix evolution conflict in generative recommenders
_reachsumit · x · 2026-09-15
Meta researchers identify 'evolution conflict' in generative recommendation: heterogeneous user preference shifts optimized in a shared autoregressive parameter space let dominant behaviors crowd out underrepresented ones. They propose three principles (isolated memorization, reinforced evolution, scalable application) and build LION around a sparse Key-Value memory layer. Paper and code are public.
More from Research
- General Reasoning explains how to train agent swarms with RL and latency pressure — rosstaylor90 · 2026-11-02
- Mathematician Tony Feng: current-paradigm LLMs lack the diversity of thought research needs — littmath · 2026-11-02
- Measure Theory vs Probability: 'You're Confusing the Finger With the Moon' — LucaAmb · 2026-11-02
- DStill Distills Multi-Step Denoising Into One Pass, 6.45x Speedup for Diffusion Speculative Decoding — LucaAmb · 2026-11-02
- Radial gate objective cuts diffusion transformer FID from 16.24 to 11.83 — Junha Park · 2026-11-02
- REA: async brain-cerebellum runtime for robots where policies never wait on the LLM — Pengfei Zhou · 2026-11-02