homie: a Mac notch voice assistant running Qwen 3.5 4B locally, with rules bypassing the LLM

KungFuSaifooo · reddit · 2026-11-22

homie is an open-source (MIT) voice assistant living in the Mac notch: Qwen 3.5 4B (Q4KM) via llama.cpp on Metal, Kokoro-82M TTS on the Neural Engine, Apple on-device STT. Since the 4B model only hits 15-30 tok/s, 600 lines of pattern rules handle everyday commands (214/214, zero false fires), skipping the LLM entirely; prompt state caches to disk. On an M5 16GB it reaches 0.43s p50 to first sound for commands, 1.17s for LLM turns. The README documents failed experiments (spec decoding, MLX vs llama.cpp, quant bake-off).

Related event: Open-source homie runs a fully local voice assistant in the Mac notch(2 posts)→

Original post →

More from Infra

Infra channel →