Splash 1.7.1 cuts Apple Silicon TTFT 23% via Neural Engine prefill, 2.9x faster shared-prompt chats

oss-jiiim · reddit · 2026-11-23

Open-source local inference engine Splash 1.7.1 ships, with menu bar companion LLMenuBar 0.0.4 supporting all new features.

New server options: --max-concurrent-requests, --sampling-default, --recalibrate-ane. Both tools install via brew.

Original post →

More from Infra

Infra channel →