LeapQuant: 8/4-bit linear attention states, training-free, 2x throughput
SonglinYang4 · x · 2026-11-13
For linear attention models, the recurrent state itself becomes the next bottleneck. LeapQuant makes 8/4-bit linear states work in a training-free way, with no accuracy degradation and 2x throughput improvement.
Related event: LeapQuant: Training-Free Quantization Speeds Up Linear Attention(4 posts)→
More from Infra
- DeepSeek V4.1-Flash seeds resist 4.3B-seed search; Huawei chip shift rumored — TheNormanMu · 2026-11-13
- OpenCartridge's trust bill: no auth, public bucket, Docker socket exposed — maier_ak · 2026-11-13
- camenduru open-sources OpenCartridge, packaging AI models as one-click 'cartridges' — maier_ak · 2026-11-13
- Game assets on your own GPU: what OpenCartridge does and what it asks you to trust — maier_ak · 2026-11-13
- Core Memory podcast: Sceye's $100M high-altitude airship wins SoftBank fleet order for Japan broadband — kyliebytes · 2026-11-13
- Torus explains closed-loop liquid cooling: no on-site water hookup needed — ccerrato147 · 2026-11-13