llama.cpp ships inside Google's Android AICore powering Gemini Nano
ggerganov · x · 2026-10-14
A user spotted llama.cpp.latest in the open source licenses of Google's Android AICore (the system service behind Gemini Nano) on a Galaxy S25 Ultra, production build 20260917, with MIT attribution to "The ggml authors".
This reveals that Google's on-device inference stack for Gemini Nano actually bundles llama.cpp as its runtime. Viewable via Settings -> Apps -> AICore -> Open source licenses. llama.cpp author Georgi Gerganov retweeted the finding.
More from Infra
- On-device web search for a 1.7B phone-local LLM, no search API or backend — K4anan · 2026-10-14
- Qwen 3.8 27B served at ~300 tokens/second on Nebius, claims fastest deployment yet — Arindam_1729 · 2026-10-14
- llama.cpp adds --spec-draft-n-ubatch option to optimize VRAM usage — jacek2023 · 2026-10-14
- Two small LLMs on a Galaxy S21 complete an Amazon shopping task locally in 51 minutes — Mean-Standard7390 · 2026-10-14
- RouterPlus pools demand so small teams get bulk-rate LLM inference pricing — rohanpaul_ai · 2026-10-14
- Adding €300 of used RAM for 80GB to run MoE models: is it worth it? — quadra-lab · 2026-10-14