Reddit deep-dive maps 15 post-transformer architectures from Mamba to Titans
Public-Feedback-6705 · reddit · 2026-10-14
A Reddit user mapped the 2026 post-transformer architecture landscape across 15 designs: Mamba-2/3, RWKV-7, BDH (Dragon Hatchling), xLSTM, Titans, plus hybrids like Qwen3-Next, Kimi Linear, MiniMax-01, Jamba, Nemotron-H, Falcon-H1, Zamba2, LFM2 and HRM.
Two comparison tables break down each architecture's core mechanism, attention variant, and test-time memory, and show how the directions overlap — most hybrid models combine linear attention with a small fraction of softmax attention layers (ratios from 3:1 to 7:1). The thesis: the next frontier is extracting more intelligence from limited compute and energy budgets rather than pure scaling.
More from Models
- GPT-6 Astra Reads Only 46% of VINs Correctly vs Sonnet 5's 86%: Routing Pays Off — arnabdotorg · 2026-10-15
- VLMs May Turn Clearly Superhuman in Vision Within a Year or Two, Researcher Predicts — arnabdotorg · 2026-10-15
- Gemini 4 Argon Trails GPT 6 Astra by Just 25 Points on Physical Agents Index — qinzytech · 2026-10-15
- GPT-6-Astra scores 98% on unpublished theoretical physics problems, catching expert errors — sandersted · 2026-10-15
- Devs report quality degradation when Kimi K3 is served via third-party providers — casper_hansen_ · 2026-10-15
- Gartner's 2026 GenAI Hype Cycle: Agentic AI still climbing, AGI 10+ years out — luisdans · 2026-10-15