Microsoft Research: Injecting Recursive Hidden States Boosts Transformer Performance for Free
furongh · x · 2026-08-12
A Microsoft AI Frontiers team shared a new project on modifying transformer training to support recursive states. Specifically, during decoding time, the previous hidden state is fed into the input alongside the token embedding. The research shows this approach is easy to implement and boosts performance for free across all measures.
More from Research
- New "Discovery Episode" Framework Measures AI Scientists by Real Research Cycles — 量子位 · 2026-08-24
- AI Claims Breakthrough on Erdős Problem Transcendence — inductionheads · 2026-08-24
- Stanford's LLM-as-a-Verifier Boosts DeepSeek Score to 88% on Terminal-Bench — Saboo_Shubham_ · 2026-08-24
- Heterogeneous Quantum Architecture Cuts Physical Qubit Needs 138x for Fault Tolerance — MJBiercuk · 2026-08-24
- InfinityEdit: Infinite Video Editing via Lightweight Adapter — Yunze Tong · 2026-08-24
- Tencent Benchmarks Hybrid-Thinking MLLMs for Response Alignment — tencent · 2026-08-24