Open-source GGUF VRAM calculator estimates context memory before you download
Dry_Wing_ · reddit · 2026-07-27
A developer built an open-source terminal utility that estimates GGUF model memory footprints before download, after running into models spilling from VRAM into system RAM and dropping to single-digit tokens/sec.
The tool, @gisaivan/anvil-advisor, calculates OS reservation overhead, context-length VRAM usage, and estimated memory bandwidth limits locally in the terminal. It is designed to help users predict whether a model will fit before they waste time downloading it.
More from Infra
- Chutes says it trained a 20B model for under $10 an hour using rented GPUs across two continents — markjeffrey · 2026-07-27
- User reports 44 tok/s ingestion and 8 tok/s generation for GLM 5.2 on a $900 rig — naunen · 2026-07-27
- llama.cpp merges support for Minimax M3 with MSA — Time_Reaper · 2026-07-27
- Windows 11 ComfyUI user gets Sage Attention and FlashAttention 2 running on RTX 5090 FE — Left_of_Laniakea · 2026-07-27
- Baseten says its GLM-5.2 API hits 280 tokens/s peak and adds vision support — iamrobotbear · 2026-07-27
- Tech Giants Back Open Source, But Is AI Infrastructure the Real Bottleneck? — myllmnews · 2026-07-27