Best local LLM for a Raspberry Pi 5 8GB offline assistant with tool calling?
Capital-Amount-6550 · reddit · 2026-09-30
A Reddit user is building a fully offline pocket assistant on a Raspberry Pi 5 (8GB) with tools like calculator, file management, offline navigation and calendar. The sticking point is model choice: they can't find an LLM that combines solid everyday-life knowledge, reliable tool calling, and acceptable tokens-per-second on that hardware, and are asking the community for recommendations.
More from Infra
- Amazon Bedrock's Capacity-Pooling Paper Hits SOSP'26 — tianyin_xu · 2026-09-30
- AI Data Center Water Debate Meets Its Match: Golf Courses — omooretweets · 2026-09-30
- TSMC reportedly evaluating plans to build chip manufacturing facilities in Texas — Polymarket · 2026-09-30
- Dumping GPUs and tokens can meaningfully speed up AI development — menhguin · 2026-09-30
- 9B Open-Weight Model Drops Agent Accuracy From 96% to 62.3% — TheZachMueller · 2026-09-30
- Jensen Huang: AI data centers add 10-20GW a year and roughly a million jobs — victor_explore · 2026-09-30