NVIDIA Open-Sources Looped Transformer Dory1-4B, Rivaling 9B Models with Recurrence

NVIDIA released Dory1-4B, an open-source looped Transformer with 20 recurrent layers reusable up to 4 times, approaching 9B-model performance. Its Elastic Latent Recurrence (ELR) method cuts the 'one-recurrence tax,' gaining 7.25 points after 4 loops.

2026-11-02 ~ 2026-11-03 · 4 related posts

• NVIDIA's Elastic Latent Recurrence lets one 4B model trade loop count for accuracy: 18→29 on AA Index — burny_tech · 2026-11-02
• NVIDIA releases Dory, a 4B looped transformer you can run at 1, 2 or 4 loops — Sam Witteveen · 2026-11-02
• Nvidia ships Dory1-4B, a looped LLM that reuses 20 layers to rival much larger models — scaling01 · 2026-11-03
• NVIDIA's Dory1-4B: A Looped LLM With 8 Input, 20 Recurrent and 8 Output Layers — scaling01 · 2026-11-03