Gemma 4 31B UD-Q8_K_XL Suddenly Hits "Exceeds Shared Memory" at 68k Context
Few_Professional6859 · reddit · 2026-09-26
A redditor reports that Gemma 4 31B (UD-Q8KXL quant) suddenly fails with an "Exceeds shared memory" error at 68k context on the exact same machine and setup that previously loaded and ran fine — suggesting a regression at the runtime/driver level rather than the model or hardware. Screenshot included. A notable bug for local long-context inference users.
More from Infra
- Google's $15B India AI datacenter draws farmer protests over confiscated land — nordicinst · 2026-09-26
- Splitting DeepSeek-V4.1-Flash across an M5 Ultra and 2× RTX PRO 6000 — harrythunder · 2026-09-26
- Nvidia's SoL-Pi cuts coding agent token usage by up to 49% by optimizing the harness — The Decoder · 2026-09-26
- Running Qwen3.8 Locally on 6x3090s with exllamav3 Hits 80-120 tok/s — takoulseum · 2026-09-26
- Meta Open-Sources Muse Glimmer: 30B Agentic Model That Fits a 24GB Consumer GPU — bibryam · 2026-09-26
- What happens when data centers must replace hundreds of billions in GPUs? — No-Papaya-9289 · 2026-09-26