How to run a private local AI on many 16GB laptops with Ollama and Gemma 4
minchoi · x · 2026-07-27
How to run a private local AI on many 16GB laptops with Ollama and Gemma 4:
- Install Ollama on macOS, Windows, or Linux.
- Run gemma4:e4b locally; the default download is about 9.6GB and can work on many 16GB machines if memory-heavy apps are closed.
- If it is too heavy, try the smaller gemma4:e2b variant.
- Once downloaded, it can run offline, and disabling Ollama cloud features keeps prompts and responses on-device.
- Optional steps show how to increase context length, use image input locally, and enforce a local-only mode via .ollama/server.json.
More from Infra
- Moonshot open-sources MoonEP as open models vs closed labs debate intensifies — KyeGomezB · 2026-07-27
- Kimi K3’s 2.5x scaling-law gain draws praise for training efficiency — andrew_n_carr · 2026-07-27
- Kimi K3 goes live on Nebius with 1M-token context and a 57 AA score — teortaxesTex · 2026-07-27
- AI agent finds a longstanding Bun Node-compat bug in `child_process.spawn` — steipete · 2026-07-27
- llama.cpp adds support for Nanbeige4.2 in pull request 25994 — pmttyji · 2026-07-27
- Open-sourced Kimi K3 speculator lifts single-stream throughput from 118 to 370 tok/s — vllm_project · 2026-07-27