Liquid AI's DSpark speculative decoding makes LFM2.5-VL-3B up to 3.13x faster
helloiamleonie · x · 2026-09-24
Liquid AI released LFM2.5-VL-3B-DSpark, an experimental speculative-decoding draft model (279.5M params) for its vision-language model LFM2.5-VL-3B. A lightweight drafter proposes tokens ahead and the target verifies them in one pass, leaving output unchanged. Benchmarks: up to 3.13x faster decoding (2.62x end-to-end) with MLX on M5 Max, 2.14x with llama.cpp on M3 Ultra, and 2.66x with SGLang on H100. Open-sourced on Hugging Face with GGUF variants; greedy decoding remains exact.
Related event: Liquid AI's DSpark Speculative Decoding Speeds Up VL Model 3.13x(4 posts)→
More from Infra
- UK Sovereign AI invests in Fractile to build next-gen frontier AI chips — charlieharris01 · 2026-11-11
- What happened when I moved vector retrieval into Snowflake SQL instead of orchestrating RAG outside — dima806_dima · 2026-11-11
- AI chip startup Fractile raises $720M Series C for DRAM-on-processor design — Tom_Westgarth15 · 2026-11-11
- Mobile AI Factory: agentic pipeline builds on-device SLMs that beat 5-shot frontier models — kalyan_kpl · 2026-11-11
- Vivo's Starlink direct-to-cell service hits 10M users in two weeks across Brazil — XFreeze · 2026-11-11
- Nan Ya Plastics to spend NT$11.53B on fifth glass fabric plant on AI server demand — zephyr_z9 · 2026-11-11