Open-Sourced Latent Sparse Attention Speeds Up Long Context 22.7x

Prefrontal AI open-sourced Latent Sparse Attention (LSA), showing that index construction takes 98% of prefill time and achieving up to 22.7x speedup on 10M-token contexts with accuracy on par with full attention.

2026-11-07 ~ 2026-11-08 · 2 related posts