LLMs-local: a curated directory for running LLMs locally hits 1.1k GitHub stars
tom_doerr · x · 2026-09-02
The GitHub repo LLMs-local (1.1k stars) curates a structured directory of platforms, inference engines, and UIs for running LLMs locally — including LM Studio, jan, LocalAI, ChatBox, lemonade, and ollama — plus sections on coding, multimodal, agent frameworks, MCP, RAG, memory, evals, fine-tuning, hardware, and tutorials.
More from Infra
- Tencent open-sources CubeSandbox v0.7.0, keeping thousands of agents alive through node failures — SucceededMind · 2026-09-03
- Magnitude open-source inference server swaps coding agents to free local models automatically — nickbaumann_ · 2026-09-03
- MiniMax H3 video generation runs fully local on a single RTX 5060 Ti 16GB — apoke890 · 2026-09-03
- With 98% Cache Hits in Coding, 400-600 t/s Prefill Already Hits Diminishing Returns — nomorebuttsplz · 2026-09-03
- Dell COO: inference tokens to grow 87x to 3,600 quadrillion by 2030 — Beth_Kindig · 2026-09-03
- Beating hipBLASLt on a gaming GPU: a GEMM optimization deep dive — Moist_Weird_42067 · 2026-09-03