ID-TAP: dueling-bandit framework personalizes LLM agents from binary feedback in a limited interaction budget

Jie Mao · hf · 2026-10-24

Researchers from CUHK-Shenzhen, U. Copenhagen, CityU HK and ECNU present ID-TAP (arXiv, Oct 2026), tackling test-time personalization: adapting LLM agents to query-dependent user preferences via binary comparisons between candidate responses as the online signal.

ID-TAP is an IDS-inspired neural dueling-bandit framework for large discrete persona spaces, combining a query-conditioned neural utility model with a lightweight Bradley–Terry explorer, and transferring comparison evidence across related queries through similarity-weighted warm starts. Code: github.com/s1412/ID-TAP.

Original post →

More from coding & agent

coding & agent channel →