VRAM Tier Testing: 10GB VRAM + 32GB RAM Runs 35B Sparse Model
OutdatedMemeKing · reddit · 2026-08-08
A developer shares a hardware configuration table based on real testing for local AI apps: no GPU runs a small chat model (2.6GB); 8GB runs chat+image+tools (5.1GB); 10-12GB adds a vision model (11.1GB); 24GB holds large model, vision, and code simultaneously (20.6GB). Surprising finding: 10GB VRAM + 32GB system RAM can run a 35B sparse model (27GB), slow but usable. Also notes model swapping matters more than model size.
More from Embodied
- Partial Autonomy is the Most Reliable Strategy for Robotics Startups — ishabytes · 2026-08-08
- OpenRoboto Launches on Bittensor to Build Open-Weight Robotics Models — markjeffrey · 2026-08-08
- Agriculture Bot Powered by XTR-0 Brain: Edge Computing Meets Robotics — mjdramstead · 2026-08-08
- Many winners expected in robotics, exciting and rewarding field — chris_j_paxton · 2026-08-08
- OpenAI's First Smart Speaker Expected in 2027, Priced Over $300 — The Decoder · 2026-08-08
- DIY Outdoor Utility Robot U-BOT: Testing 3D Printed Drive Components — _Stocko_ · 2026-08-08