Semantic subword tokenization improves generative recommenders by reducing intra-item attention overload

_reachsumit · x · 2026-08-25

The paper proposes Semantic Subword Tokenization (SST), which compresses user history into reusable subword tokens instead of fixed codes, reducing intra-item attention overload and freeing capacity to model item relationships. Experiments on three public datasets and three generative recommender backbones show improvements over fixed-length and variable-length SID baselines. Accepted to CIKM 2026.

Original post →

More from Research

Research channel →