Researchers praise Kimi's new architecture for adopting attnres: "best taste"
SonglinYang4 · x · 2026-11-13
Researchers highlight that Kimi's new architecture has adopted the attnres (attention residual) design, with one commenting the architecture "has the best taste." An early, credible signal about Kimi's architecture choices ahead of any official disclosure.
More from Models
- Raon-1 nano tops consumer-GPU agent tests: 96/96 tasks, 187 tok/s at ~2GB Q4 — Kangwook_Lee · 2026-11-13
- Same harness, same rules: Argon used the code graph in 12/17 sessions, Opus only 4/17 — rseroter · 2026-11-13
- Massive eval table update benchmarks open-weight models across coding, finance, legal — siyan_zhao · 2026-11-13
- Did Kimi K3 and DeepSeek-V4-Pro each train on 2,000-3,000 Blackwells? Claim disputed — teortaxesTex · 2026-11-13
- Community notes: Ling's Blackwell usage was an open secret, papers admitted renting compute — teortaxesTex · 2026-11-13
- Gemini 4 Hydrogen hits frontier-level scores at 1/3 the cost of Anthropic's flagship — Electronic-Weekend66 · 2026-11-13