6 open source tools to run AI locally on your laptop, no cloud required
alex_verem · x · 2026-11-01
alexverem argues you shouldn't pay for cloud AI your laptop can run for free, citing a 20% PC shipment drop last quarter and rising memory costs. He lists 6 open source tools for local AI: Jan (offline chatbot, 3B models on 8GB RAM), AnythingLLM (chat with your own docs), Buzz (offline transcription), Upscayl (free image upscaler), and exo (clusters your devices to run bigger models), each with GitHub links.
More from Infra
- Where the money goes per token: a diagram of LLM API cost anatomy — cneuralnetwork · 2026-11-01
- FreeToken brings datacenter-scale MoE model serving to desktops, hits 15k stars — FlashML-org · 2026-11-01
- Musk claims xAI's capex efficiency is greatly underestimated — RachelVT42 · 2026-11-01
- AI bubble pops globally: China wipes out ¥23.5T, Nasdaq drops 3.46% in a day — Grady_Booch · 2026-11-01
- Strata engine underwhelms on 2× R9700: loses to llama.cpp despite higher t/s — Don_Reuter · 2026-11-01
- exo clusters your Macs into one AI machine to run frontier models locally — alex_verem · 2026-11-01