On-device AI settles on small active-parameter models: phone-class agents at 1B and below

lmoroney · x · 2026-10-15

Laurence Moroney observes that local agents are converging on models with only a few active parameters, with phone-class AI now happening at 1B and below. Signals: Liquid's 2B-active model, MiniCPM-V 1B running on phones, and a faster Gemma NPU build — all pointing the same way toward small-active-parameter models as the default for on-device agents.

Related event: Small-Activation Models Emerge as the Norm for On-Device AI Agents(2 posts)→

Original post →

More from Infra

Infra channel →