UW's Mobile AI Factory Auto-Builds Phone-Specific Small Language Models

UW · hf · 2026-11-16

Researchers at UW's Paul G. Allen School (Evan Li, Krishna Deshpande, Wen Cheng, Shyamnath Gollakota) present Mobile AI Factory, an agentic system that automatically builds fine-tuned, quantized small language models tailored to a given task and target phone.

Given a task spec and budget (e.g. "extract drugs and diseases from a clinical note in under 1s per request"), an orchestrator LLM decides whether to tune hyperparameters, mine real data, or generate synthetic examples, while fixed rules roll back changes that hurt accuracy. The factory searches base models and quantizations from small to large, guided by real on-device measurements across inference engines and backends.

Evaluated on ten tasks across four Android phones (OnePlus 15, Galaxy S23, OnePlus 8 Pro, Redmi 9A), the resulting on-device models match or outperform larger models on unseen test sets with far less GPU time. Local SLMs keep user data private and work offline.

Original post →

More from Infra

Infra channel →