How much VRAM do you actually need for local document AI like paperless-ai?
pjdonovan · reddit · 2026-09-06
A Reddit user asks about local AI hardware requirements: their only use case is document management with paperless-ai, plus optional Home Assistant integration.
They wonder whether a 12GB GPU running a 6-10GB model delivers a good experience, or whether 32GB VRAM is necessary—a common budget-vs-experience question for local deployment.
More from Infra
- AMD exec: AI token processing could hit 120 quadrillion per month by 2030 — zephyr_z9 · 2026-09-06
- MiniMax-H3 Lip Sync on 8GB VRAM: Multishot Renders in 26 Minutes — big-boss_97 · 2026-09-06
- Oura's S-1 reveals an on-device AI stack: small models and edge compute, not cloud inference — eurie_kim · 2026-09-06
- Bosgame M5 Max With Ryzen AI Max Pro 495 and 192GB RAM Arrives October 2026 — Terminator857 · 2026-09-06
- A pragmatic guide to local agentic LLMs: compile buun's llama.cpp free on GitHub runners, Qwen3.8 27B quants span 30x — apollo_mg · 2026-09-06
- Cloud in a Bottle Launches to Make Self-Hosting Accessible to Everyone — zplizzi · 2026-09-06