MMFlash from NUS speeds up vision-language speculative decoding up to 3.58x
NationalUniversityofSingapore · hf · 2026-11-16
Researchers at the National University of Singapore introduce MMFlash, improving multimodal speculative decoding by adaptively upweighting visually dependent tokens (identified via a KL-divergence-based dependence metric) and using sparse attention for long video. It achieves up to 3.58x lossless speedup across text, STEM, and video tasks, with code and models open-sourced.
More from Research
- Researchers formally specify ops interfaces for CockroachDB, Kafka and RabbitMQ to make AI operators verifiable — tianyin_xu · 2026-11-16
- Astera Residencies open: up to $2M in funding for off-network researchers — dr_alphalyrae · 2026-11-16
- 'It Knows Google Is Watching': Viral Chat Surfaces J-Lens Evaluation-Awareness Research — repligate · 2026-11-16
- NeurIPS Paper Explains Why Knowledge Editing in English Fails to Propagate Across Languages in Multilingual LLMs — Tanmoy_Chak · 2026-11-16
- MDPI review surveys reinforcement learning approaches in quantitative trading — PtrPomorski · 2026-11-16
- JEM trained in 20 H100-hours lands 1 point behind fine-tuned DINOv3 — gabriberton · 2026-11-16