ARLoop releases fully-open looped LLMs: 1.2B beats Huginn-3.5B and Qwen3.5-2B

burny_tech · x · 2026-11-10

ARLoop is a family of fully-open pretrained looped transformers with Attention Residuals. The strongest model, ARLoop-1.2B, outperforms both Huginn-3.5B (a prior fully-open looped LLM) and Qwen3.5-2B Base on benchmarks across commonsense reasoning, math, and coding.

Noting that open weights are emerging but training recipes remain scarce, the team releases the full recipe: data preparation, training, intermediate checkpoints, and evaluation code.

Related event: ARLoop: Fully Open-Source Looped Transformers, 1.2B Beats Huginn-3.5B(5 posts)→

Original post →

More from Research

Research channel →