apple-llm: Node/Python wrapper for the free local LLM built into Apple Silicon Macs
light_2earth · reddit · 2026-09-28
Apple Silicon Macs running macOS 26+ ship with a small built-in LLM — no download, no API key, nothing leaves the machine. The author hit real pitfalls wiring it up (repetition at temperature 0, 2s calls turning into 20s, 17s calls until keeping one process alive) and packaged the fixes into apple-llm (npm / pip install apple-llm).
Good for: structured extraction from messy text (emails→tickets, receipts→expenses, schema-matching JSON), tagging/summarising/rewriting, private data, and tools shared with Mac users who need no model or key. Bad at: coding and long reasoning. An optional cloud mode uses Apple's larger server model, but prompts leave the device and carry usage limits. GitHub: github.com/jagdishpal02000/apple-llm
More from coding & agent
- Agents Now Reply to Slack Messages on Their Own, Resolving a Prod Incident Ghost-to-Ghost — iamrobotbear · 2026-11-16
- Engineer's Interview Prep Method: Use Claude to Find Which Answers Undersell Your AI Work — brandon_galang · 2026-11-16
- Generic API-catalog MCP server vs one tool per job: a context-bloat experiment — MandeepKaur9407 · 2026-11-16
- Berkeley paper: LLMs answer with stale values even when the update is in context — ombre-ai · 2026-11-16
- Effective HTML: 4.2k-star agent skills turn wireframes into self-contained interactive prototypes — tom_doerr · 2026-11-16
- skills-gate: one gate skill fronts 148 agent skills at just 389 tokens — Distinct-Pie2389 · 2026-11-16