LoopVL: recurrent vision-language model beats larger non-recurrent peers, shows Visual Aha Moments
RUC · hf · 2026-10-01
RUC introduces LoopVL, extending Loop Transformers to vision-language models.
- Combines Module-Loop and Model-Loop computation to iteratively update a unified vision-language state through shared modules, trained from scratch via language pretraining, multimodal training, and post-training.
- Outperforms a range of similarly sized and larger non-recurrent models on multimodal understanding and visual reasoning benchmarks.
- Observes "Visual Aha Moments": pronounced shifts in visual attention across loops.
The work offers practical evidence for recurrent vision-language modeling and a lens on how shared parameters support deeper multimodal computation.
More from Multimodal
- Video editor asks r/ how to keep characters consistent in ComfyUI microdramas — moonshoter · 2026-11-16
- Tencent's Hy4 Flash builds a 3D game with shield mechanics in 63 minutes, beating Hy4's 90 — ShunyuYao12 · 2026-11-16
- Hy4 Flash 3D voxel demo outpaces DeepSeek-V4.1 in same-prompt comparison — ShunyuYao12 · 2026-11-16
- Stunning AI-generated video: mechanical samurai armor in silver and blue — ZidanStudio · 2026-11-16
- AI-generated Red Rising fan video: Storytime with Papa Sevro — -VoiceoverAlex- · 2026-11-16
- Midjourney --sref trick: one style code yields fluffy rooster monsters, full params shared — michaelrabone · 2026-11-16