MixTok hybrid tokenizer hits gFID 1.95 on ImageNet with just ~131 tokens per image

ZhejiangUniversity · hf · 2026-10-12

Zhejiang University, HKUST, and the University of Adelaide introduce MixTok, a hybrid visual tokenizer combining a compact 1D global representation with sparse 2D refinement tokens. A content-adaptive router ranks candidate locations and allocates the 2D token budget per image. On ImageNet 256x256 it achieves rFID 1.195 and gFID 1.95 at average budgets of roughly 128 and 131 tokens per image, balancing compactness with fine detail.

Original post →

More from Multimodal

Multimodal channel →