hf-mem v1.0.0 estimates LLM inference memory without downloading weights
SergioPaniego · x · 2026-11-17
Hugging Face's hf-mem v1.0.0 estimates inference memory requirements (weights, KV cache, runtime overhead) without pulling model weights, supporting Safetensors, GGUF and ONNX via HTTP range requests, with only httpx2 as a dependency. Run e.g. uvx [email protected] Qwen/Qwen3.8-27B --max-model-len 32768 --gpu-memory 96 for a per-component breakdown — useful for humans and agents alike.
More from coding & agent
- YC launch CoverAgents turns broker emails into carrier quotes in 3 minutes, 90+ agencies live — ycombinator · 2026-11-17
- Open-source REQL builds code graphs to cut coding agents' token waste — cl0wnfire · 2026-11-17
- Using Figma MCP to let Claude create designs and prototypes straight into Figma — Tegadesigns · 2026-11-17
- Arkenos v0.6.12 ships set-and-forget autonomous research agents with free tier — _AustinCalvert_ · 2026-11-17
- Cloudflare open-sources Kitesurf browser engine for agents, ships DO and spend-limit updates — ritakozlov · 2026-11-17
- SWE-bench co-author on building influential AI benchmarks: start with people — OfirPress · 2026-11-17