Perplexity open-sources its Mac inference server optimized for Qwen 3.6 on Apple Silicon
Specter_Origin · reddit · 2026-09-03
Perplexity has open-sourced its Mac local inference server (the lily project inside its pplx-garden repo) on GitHub.
- The server is heavily optimized for a single model, Qwen 3.6, to squeeze the best performance out of Apple Silicon
- A ready-to-use option for developers running local models on Macs
Related event: Perplexity Open-Sources Lily, a Local Inference Engine for Apple Silicon(8 posts)→
More from Infra
- ClickHouse aggregates 100B rows in 0.4s with parallel replicas auto-scaling — Abhishekcur · 2026-10-18
- Auction-based LLM routing paper finds fixed token pricing wastes 10%-71% in costs — _onionesque · 2026-10-18
- Running Ling 3.1 Flash (560B MoE, 25B Active) Across 4 DGX Sparks via llama.cpp RPC — BerryBlush_Rogers691 · 2026-10-18
- SGLang Summit sponsors jump from 11 to 36 in one week — ying11231 · 2026-10-18
- Oracle CDS hits record 300bps, called first AI trade domino after Barclays sell downgrade — arthurcolle · 2026-10-18
- Agent Coding Workflow Would Cost ~$40k/Month on API Pricing, Dev Reveals — ChrisRackauckas · 2026-10-18