Researchers show VLMs plan via image pointers before generating a single token

gsarti_ · x · 2026-11-20

Researchers at Northeastern's Bau Lab (Rohit Gandikota, David Bau et al.) opened up a VLM to see how it decides what to describe first, next, and when to stop.

Key findings:

An interactive demo and source code let you watch the plan live.

Original post →

More from Research

Research channel →