GPT-X3-150M tops Open SLM Leaderboard, dethrones SmolLM2-135M with GDN2/GQA hybrid

datdanboi25 · reddit · 2026-10-25

AxiomicLabs' GPT-X3-150M takes #1 on the Open SLM Leaderboard with an Intelligence Index of 33.05, beating HuggingFace's SmolLM2-135M (27.13) to become the strongest generalist base model ever evaluated under 150M parameters.

It uses a GDN2/GQA hybrid architecture, was trained with roughly 27× fewer tokens, and ran on consumer hardware. Weights are open on Hugging Face.

Related event: GPT-X3-150M tops Open SLM Leaderboard with fraction of training compute(2 posts)→

Original post →

More from Models

Models channel →