Devs call for more 100-200M open models; Gemma 3 270M remains the last release

cephaloform · x · 2026-11-02

Developers are calling for more 100-200M parameter open models for experiments: the last release in this size class was Gemma 3 270M, and its license isn't great. One dev says this size class is perfect for lazily parameterizing strange generative grammars, but they can only train up to 10B tokens before losing patience — smaller models would drastically lower the experimentation barrier.

Related event: Developers Call for Community to Fill 100-200M Parameter Model Gap(2 posts)→

Original post →

More from Models

Models channel →