VFlash finding: lightweight drafter can beat its autoregressive target on decoding accuracy

ZhidingYu · x · 2026-11-06

Counterintuitive finding from the VFlash thread: a lightweight drafter can outperform its autoregressive target on decoding accuracy — contradicting the LLM speculative decoding assumption that AR is the accuracy upper bound, so verification can be skipped in some tasks. The author speculates visual intelligence may be fundamentally parallel prediction while LLM intelligence is autoregressive. Physical AI decoding is characterized by rich output types (text planning plus visual primitives), structured outputs (points, boxes, trajectories), and versatile decoding requirements.

Related event: NVIDIA Unveils VFlash: A System-1 Parallel Decoding Framework for Physical AI(10 posts)→

Original post →

More from Embodied

Embodied channel →