New paper: Transformers are inherently succinct, probing a theory-practice gap
chrmanning · x · 2026-08-19
Stanford's Chris Manning highlights "Transformers are Inherently Succinct" by Pascal Bergsträßer, Ryan Cotterell & Anthony Widjaja Lin.
Context: prior work (Hahn 2020, Li & Cotterell 2025) showed transformers are formally less powerful than RNNs—yet they excel in practice. The paper offers an interesting new angle on this apparent paradox.
Related event: New Paper: Transformers Are Inherently Succinct, Explaining Edge Over RNNs(2 posts)→
More from Research
- Can public chat data predict real-world AI misalignments? — yoavartzi · 2026-08-20
- Research exposes LLM API vulnerability leaking hidden chain-of-thought — burkov · 2026-08-20
- Z Image HSWQ Hybrid Quantization Boosts VRAM and Speed — Zestyclose_Bake3680 · 2026-08-20
- The Human-or-Machine Issue: Turing-Inspired Reflections — ArtificialOther · 2026-08-20
- Meta Research Challenges Chinchilla Scaling Laws on Data-Compute Interactions — burkov · 2026-08-20
- 14,472 AI citations analyzed: business websites still win 60% of local search citations — gaganghotra_ · 2026-08-20