10 open-source GitHub repos to run AI models locally on your laptop
victor_explore · x · 2026-11-09
A curated GitHub compilation of 10 open-source repos covering the full local-AI stack: run models, serve an OpenAI-style API, cluster devices, and pick models that fit your RAM.
- Ollama (183k stars): easiest way to run Kimi, GLM, DeepSeek, Qwen and more locally
- llama.cpp (131k stars): the C/C++ inference engine behind most local AI apps
- LocalAI (69k stars): self-hosted drop-in for the OpenAI API
- exo (48k stars): join your devices into one AI cluster
- Jan (45k stars): offline desktop ChatGPT replacement
- llmfit: tells you which models will run on your machine
- llamafile (26k stars): model and runtime in a single file
- Plus MLX LM (Mac), llama-swap (one endpoint, on-demand model swaps), and Lemonade (local AI server for Windows/Linux)
More from coding & agent
- One-person site with 27 followers made $4,800 in a day, found via Claude Code revenue scan — FinanceYF5 · 2026-11-09
- The churn era: customers now use Claude to slop up replacements for overpriced SaaS — joshgonsalves_ · 2026-11-09
- Designer builds AI pipeline that finally nails map interchange generation after 2 weeks — tomjohndesign · 2026-11-09
- AI lets designers build wild ideas, but knowing the low-level stack matters more than ever — nptacek · 2026-11-09
- Gemini CLI PR fixes orphaned child processes and wrong exit codes on headless abort — duvanka-prasad · 2026-11-09
- T3 Code hands-on: one GUI orchestrates Claude Code and Codex sessions — vista8 · 2026-11-09