NVIDIA releases Dory1.0-4B: latent-recurrent GPT with 256K context and interleaved attention
petrusenko_max · x · 2026-10-17
NVIDIA Nemotron Labs published NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16 on Hugging Face: a 4B-parameter looped latent-recurrent normalized GPT with interleaved sliding-window and full attention, supporting up to 256K tokens of context, BF16 weights, English, under the OpenMDW 1.1 license, release date Oct 16, 2026.
Related event: NVIDIA Open-Sources Dory 1.0, a 4B Recurrent Model with 256K Context(2 posts)→
More from Models
- DeepSeek V4.1 Flash claims to be ChatGPT in identity checks, screenshot shows — scaling01 · 2026-10-18
- GLM 5.3 finds arbitrary-write vulnerability in Apollo 11 guidance code — moyix · 2026-10-18
- Google AI flags its own generated character as a celebrity mid-project — noisywan · 2026-10-18
- Grok's "complex age dynamics" phrasing for historical abuse draws flak — eigenrobot · 2026-10-18
- Dev revisits Opus 4.6 project with Opus 5.5, finds it spotting old bugs unprompted — rms80 · 2026-10-18
- DeepSeek V4.1-Flash-1017 claimed to hit Opus 5-level coding scores at 83x lower cost — Yuchenj_UW · 2026-10-18