Tencent releases Simple-Attention-Sparsification: sparse attention for long-context Qwen3-14B
tencent · hf · 2026-09-14
Tencent released Simple-Attention-Sparsification (SAS) on Hugging Face, a text-generation model finetuned from Qwen3-14B.
- Focus: sparse attention for long-context inference, built on an attention sparsification method
- Trained on the open-r1/OpenR1-Math-220k math reasoning dataset
- Ships with a paper (arxiv:2609.13141) and sglang inference support
Related event: Tencent Open-Sources SAS Sparse Attention Method(4 posts)→
More from Models
- Anthropic files for Nasdaq IPO: $16.3B H1 revenue, compute spend down to 0.5x revenue — DeepLearningAI · 2026-10-31
- ThursdAI crew debates: with Opus 7 coming, who still cares about better benchmarks? — thursdai_pod · 2026-10-31
- Swift 1.5 Flash Next Heretic quants add IQ4_XS and IQ3_S tuned for reverse engineering — jjusko20 · 2026-10-31
- 14 models tested on 960 analyst tasks: AI scores 97/100 as analyst, picks winners no better than random — HeyAmit_ · 2026-10-31
- Anthropic adds invisible text watermark to Claude outputs starting Nov 3 — petesena · 2026-10-31
- GPT-6 Luna vs GPT-6.1 Terra vs GPT-6.1 Sol vs GPT-6 Astra in Pixel Art — Angaisb_ · 2026-10-31