iQuantize: open-source desktop workspace for guided GGUF/MLX/ONNX LLM quantization
Zipidyzip · reddit · 2026-11-07
A developer released iQuantize, an open-source (Apache 2.0) desktop quantization workspace that turns the full LLM quantization pipeline into a guided, visual workflow.
- Load local Safetensors or pick any model from Hugging Face
- Step-by-step conversion to GGUF, MLX, and ONNX, visualizing tensor-level changes
- Compare quantized output against the original side by side (perplexity, KL divergence, speed)
- Publish to Hugging Face with an auto-generated model card documenting the process
- One-click setup installs Python, llama.cpp, and per-format environments privately
Deep testing has mostly been on Apple Silicon; Windows and Linux builds exist but are less tested, and contributors are welcome. Repo: github.com/Fazmin/iQuantize
Related event: iQuantize: Open-Source Desktop Tool for One-Click LLM Quantization(2 posts)→
More from Infra
- SpaceX reportedly orders 6,000 racks for 2027 space data centers, 1GW in orbit — Eliv_nurotic · 2026-11-07
- Crusoe Sells Troubled Wyoming Data Center Project to Google — TechCrunch AI · 2026-11-07
- SemiAnalysis says tighter GPU financing supports rents, not a glut — analysts push back — bookwormengr · 2026-11-07
- Inkling 2 Small pretrained on 8.4T tokens in 68 hours, natively in NVFP4 — teortaxesTex · 2026-11-07
- CorebrumOS, a Physical AI OS, now installs on any Ubuntu device including MacBook Pro — chrismatthieu · 2026-11-07
- Beam report also covers optimization, training dynamics and hyperparameter transfer — brandondamos · 2026-11-07