Meta's Guided SID: Pinning Coarse Semantic ID Levels Makes Fine Levels Learnable
_reachsumit · x · 2026-09-22
Meta published Guided SID on arXiv (2609.22227) for generative retrieval, where items are represented by short Semantic IDs and recommendation is cast as autoregressive generation. Since tokenizers trained independently don't align with downstream LLMs or the end task, existing SID systems need extra bridging effort.
Method: force the coarse RQ-VAE levels to encode a predefined categorical attribute — text-grounded (legible to the LLM) and task-relevant — via deterministic supervised index assignment while keeping codebooks learnable; a trie-merge construction maps high-cardinality attributes onto the fixed code budget.
Results: guiding costs nothing intrinsically; in a matched end-to-end A/B, the guided retriever improves recall@k at every list length (up to 1.36 points).
More from Research
- Author says his CHI2027 ADR paper was better than papers he reviewed — windx0303 · 2026-11-12
- Google launches AlphaGenome 2 to predict how DNA variants affect specific cell types — sundarpichai · 2026-11-12
- New learning rule boosts Hopfield network memory capacity over 10×, per Nature Communications study — bravo_abad · 2026-11-12
- CoRL results show sim-only training now delivers top real-world robot performance — carlosdponx · 2026-11-12
- Google team pushes neural cellular automata to multi-step visual reasoning — bratton · 2026-11-12
- NeoMME: 255x smaller multimodal embeddings while keeping >95% nDCG@10 — antoine_chaffin · 2026-11-12