WinARDet: compressed window autoregression stops box repetition loops in dense grounding

NankaiUniversity · hf · 2026-10-21

Nankai University and BNU propose WinAR, addressing MLLM-based detectors looping on identical boxes in dense scenes. They attribute the failure to historical-answer attention takeover: under full-history autoregression, repeated coordinate tokens attract disproportionate attention, crowding out attention sinks needed for new visual evidence. WinAR partitions long answer sequences into generation windows, restricts full token-level autoregression to the current window, and compresses prior windows into a fixed set of latent tokens, cutting exposure to raw historical coordinates while preserving cross-window dependencies. Validated on RS Dense with 200–2,000 objects.

Original post →

More from Multimodal

Multimodal channel →