Perplexity goes local: private tasks hand off to on-device small models
HowDevelop · x · 2026-09-07
Perplexity's Aravind explained on CNBC why the company went local: frontier models stay in the cloud, but the moment a task touches health records or tax returns, it hands off to a smaller model on the user's own hardware.
This supports the view that every AI product ends up with a local half, driven by privacy first, cost second — and the hard part is running it on whatever machine the user already owns. The open-source goose-mobile-ondevice-llamacpp project demonstrates on-device agents with goose and Gemma on Qualcomm devices via llama.cpp, including an iOS client on the App Store and an experimental Android full-device automation PoC.
More from coding & agent
- QA loops fix AI front-end code from Figma files at half a weekly subscription cost — jdjohnson · 2026-09-07
- Astra complaints solved by one line in agents.md, dev says model is highly personalizable — pvncher · 2026-09-07
- AI model installs OpenFOAM, runs CFD and even routes wires in wild engineering demo — yacineMTB · 2026-09-07
- prompt-audit command cleans stale CLAUDE.md instructions when upgrading Claude projects — RLanceMartin · 2026-09-07
- Vibe coders can pick any language, yet they still default to JavaScript — JoshuaJBouw · 2026-09-07
- Yacine shows AI coding agent auto-routing wires after being asked to make it foolproof — yacineMTB · 2026-09-07