Perplexity's 5B decision model runs free on your Mac, distilled from its 7B model
Saboo_Shubham_ · x · 2026-10-26
A locally-runnable decision model, Perplexity's pplx-decider-flash-v1.2, is available free on Hugging Face with no API key required.
Per the model card: it's built on Qwen3.5-4B and distilled from Perplexity's 7B decision models (the student learns the teacher's full probability distributions, not just answers), at about one-seventh the size with text and image support under Apache-2.0. Evaluations show it keeps most of the 7B model's Decision Index and vision scores, making it suitable when latency or cost matters more than peak accuracy. It logged 1,900 downloads last month.
Related event: Perplexity Open-Sources Decision Model That Runs Locally on Mac(2 posts)→
More from Infra
- OpenAI's agent built the same site 8 times — every deployment landed on Cloudflare — FinanceYF5 · 2026-10-26
- Building AI infra may be easier than selling AI outcomes with clear ROI — seankinneyRCR · 2026-10-26
- Izwi 0.1.0 ships fully local voice AI with TTS, cloning and diarization — zinyando · 2026-10-26
- Frontier security models will need new compute classes, quantum likely first — BenBajarin · 2026-10-26
- DesignArena data: Gemini 3.8 Flash quality degrades sharply weeks after launch — legit_api · 2026-10-26
- Chart: Data centers funded via SPV structures keep hyperscaler debt off balance sheet — SumitGup · 2026-10-26