How Large a Model Can Run on 8GB VRAM
Tonka-Jahari-Pizza · reddit · 2026-07-14
The author asks: on a mobile device with 8GB VRAM, what is the largest model that can be run, and if anyone has practically tested such a setup.
Their goal isn't for chatting, but to run a simple agent for creating folders, writing txt/md files, and executing basic scripts and shell operations.
More from coding & agent
- Devin adds e2b sandboxes for remote agent execution — badphilosopher · 2026-07-22
- Hermes Agent Refactoring Proposal: Decoupling via Event Bus and Monorepo Slicing — Promptmethus · 2026-07-22
- ty now reads Pydantic config keywords and field metadata — charliermarsh · 2026-07-22
- Pensar Launches AI Security Agent to Autonomously Discover and Patch 0-Days — andriy_mulyar · 2026-07-22
- ty adds first-class Pydantic support, including strict and lax field handling — charliermarsh · 2026-07-22
- Google launches Gemini 3.5 Flash Cyber for CodeMender, with limited access for governments — GoogleAI · 2026-07-22