Unsloth UD_IQ1_M Quant Saves 6GB but Breaks Tool Calls in Real Use
SomeoneInHisHouse · reddit · 2026-11-13
A user tested Unsloth Dynamic 3.1's UDIQ1M quant on Strata: official charts show it beats IQ3XXS at 6GB smaller size, freeing RAM. But in 3 days tool calls repeatedly failed and rendered as raw XML requiring a manual "keep going", whereas two months on IQ3XXS had zero such issues. The post includes the failing output and asks the community if they've seen the same.
More from Infra
- Fab capacity jumps to 1.117M 8-inch-equivalent wafers/month, 78.9% on 12-inch — teortaxesTex · 2026-11-13
- Microsoft and Claude go down simultaneously, taking apps offline with them — ThePeterMick · 2026-11-13
- llama.cpp ships v1.0.0, the landmark first stable release for local LLM inference — TheApadayo · 2026-11-13
- Singapore files 41 charges against man in alleged Nvidia AI chip smuggling scheme to Malaysia — Polymarket · 2026-11-13
- Meme: All modern digital infrastructure rests on one tiny Model Hub pillar — pcuenq · 2026-11-13
- Agent Substrate claims 500 resumes/sec, but one 24-vCPU node delivers 37 — a measured deep dive — ghumare64 · 2026-11-13