MMFlash speeds up vision-language models up to 3.58x with lossless speculative decoding
NUS researchers introduced MMFlash, a vision-aware speculative decoding framework for vision-language models that uses KL-divergence-based token-level visual dependency weighting and sparse attention for long videos, achieving up to 3.58x lossless inference speedup.
2026-11-16 ~ 2026-11-16 · 2 related posts
- MMFlash from NUS speeds up vision-language speculative decoding up to 3.58x — NationalUniversityofSingapore · 2026-11-16
- MMFlash boosts vision-language speculative decoding with up to 3.58x lossless speedup — _akhaliq · 2026-11-16