FlashLoop Speeds Up Looped Transformers by Exploiting Cross-Loop Redundancy

FlashLoop exploits cross-loop redundancy in Looped Transformers to cut inference cost, reducing latency by 1.65x while addressing the growing KV cache overhead of repeated loops.

2026-09-26 ~ 2026-09-26 · 2 related posts