Measured VRAM use of Qwen3.5 9B and Gemma 4 E4B on a 3060 12GB, plus a free fit calculator

sdatta11 · reddit · 2026-11-20

The author measured real VRAM use with LM Studio (llama.cpp CUDA, Q4KM, full GPU offload) and built a free browser-based calculator (within 1% of measurements).

Measured data (4K/16K/32K ctx):

Two findings:

The calculator covers 54 desktop/laptop GPUs and 40 models at Q4/Q5/Q8/FP16 (weights + KV cache for full-attention layers + 0.6 GB runtime), flags "runs on GPU / spills to RAM / won't run", and outputs the ollama command for the biggest model that fits. No sign-up, runs entirely in-browser.

Original post →

More from Infra

Infra channel →