Community project turns EmbeddingGemma 2 into an on-device classifier at ~20ms per text input

googlegemma · x · 2026-11-05

Google's Gemma team highlighted a community project that skips a full multimodal LLM and instead trains a lightweight classifier on top of EmbeddingGemma 2 in real time.

Because the model is compact and natively multimodal, it can learn new categories on the fly and classify inputs locally in 20ms for text and 100ms for images — a creative repurposing of an embedding model for on-device classification.

Original post →

More from Models

Models channel →