IBM Granite 4.2 8b Blooms to 27GB VRAM Despite 5.2GB Download
x8code · reddit · 2026-08-26
A user running IBM Granite 4.2 8b via Ollama on a 16GB RTX 5060 Ti observed the VRAM usage spike to 27GB, despite the model file being only 5.2GB. This prevents it from fitting on the GPU, prompting a question about whether this is expected behavior.
More from Infra
- Microsoft AI accelerators blur scale-out and scale-up network boundaries — bookwormengr · 2026-08-26
- WFE Forecast Targets $250B by 2028, Buy-Side Even More Bullish — BenBajarin · 2026-08-26
- Most detailed technical paper on ANE released — pcuenq · 2026-08-26
- Local AI Hits Inflection Point with Open Source Models and Powerful Hardware — inductionheads · 2026-08-26
- Qwen2.5-72B INT8 benchmark: vLLM config and optimization on A40 — OvertaxedOne · 2026-08-26
- Chinese AI Firms Rush to Inner Mongolia, Water Shortage Looms — basedjensen · 2026-08-26