NVIDIA's Dory1-4B: A Looped LLM With 8 Input, 20 Recurrent and 8 Output Layers
scaling01 · x · 2026-11-03
NVIDIA recently released Dory1-4B, a looped LLM with 36 layers: 8 input layers, a recurrent block of 20 layers (looped 1, 2, or 4 times), and 8 output layers. The architecture shows the 'looped' recurrent approach is now materialized in an actual released model.
Related event: NVIDIA releases Dory1-4B, a looped LLM reusing 36 layers to rival 9B models(2 posts)→
More from Models
- ML4 Goes Open-Weight: Frontier Code Agent and Cyber Capabilities, Far More Compact Than Preview — _AndrewZhao · 2026-11-03
- OpenRouter: heavy users now median 6 model families, 2x in a year — sarahookr · 2026-11-03
- Killed by Google eulogizes AI Overview — 'not yet,' replies a user — gaganghotra_ · 2026-11-03
- DeepSeek's 'super agent' sparks debate: is the meat proxy era over? — gdechichi · 2026-11-03
- Only 3% of humans beat Claude Opus 5.5 at predicting what people click — teortaxesTex · 2026-11-03
- Nvidia ships Dory1-4B, a looped LLM that reuses 20 layers to rival much larger models — scaling01 · 2026-11-03