awesome-local-llm: a 2.6k-star curated list for running LLMs locally
tom_doerr · x · 2026-08-20
The GitHub project awesome-local-llm (2.6k stars, 339 forks, 299 commits) curates platforms, tools, practices and resources for running LLMs locally — a maintained list useful as a starting point for anyone deploying models on their own machine.
More from Infra
- Speculative decoding boosts Jetson performance: Qwen 3.8 27B triples speed — JFPuget · 2026-08-20
- Community vote ranks top AI supply chain startups: MatX, American Terawatt lead — sonofalli · 2026-08-20
- AI chip startup Fractile in talks for $6.5B valuation after $250M Anthropic deal — dinabass · 2026-08-20
- Bittensor SN110 deploys 250 RTX 5090s for permanent green compute — bittingthembits · 2026-08-20
- Addy Osmani uses Agent loops to triage 90 daily PRs — rseroter · 2026-08-20
- Semiconductor EPS growth to reach 48%-97% (2024-26), outpacing hyperscalers — Beth_Kindig · 2026-08-20