Run Gemma 4 locally with one Ollama command: 7-10GB, offline, no subscription caps
nikola_mr64990 · x · 2026-11-14
rakibhossenai shares a cost-saving setup: keep one paid subscription for hard tasks and run a free local model for everything else. Install Ollama, run ollama run gemma4 (7-10GB download), and chat offline with data staying on-device; older laptops can use the smaller gemma4:e2b. The author admits local models won't match cloud flagships on complex reasoning. A screenshot shows gemma4 on Ollama with 28.7M downloads, offering vision, tools, thinking, and audio across sizes from e2b to 31b.
More from Infra
- Openship: self-hosted deployment platform with built-in CI/CD hits 15.3k GitHub stars — jackedAJ · 2026-11-14
- MiniMax H3 I2V on a 5090: cu130 torch fix kills OOM, 0.98MP x 20s in ~21 minutes — Realistic-Fennel-190 · 2026-11-14
- Inkling Small 2 fits on 4x RTX Pro 6000 with 7.5M token KV cache at 120 tok/s — LiTianleli · 2026-11-14
- Perplexity team teases minimalist LLM trainer built with coding agents, open source soon — BanghuaZ · 2026-11-14
- Serving many fine-tuned variants of a 27B model on one GPU: 4-bit CQ format and 55x smaller adapters — textclf · 2026-11-14
- Musk: Future Starship Flights Will Carry Over 50 Tb/s of Starlink Bandwidth to Orbit — elonmusk · 2026-11-14