Reddit reports GLM-5.2 crashes with all-NaN logits past 32k to 64k context
naunen · reddit · 2026-07-26
A Reddit user reports that GLM-5.2 runs normally at 8k context on a mixed CPU/GPU setup, but crashes as soon as context grows past roughly 32k–64k.
They describe an all-NaN failure in llama-sampling.cpp on the first generated token, after trying multiple fixes: toggling DSA and flash attention, shrinking batch sizes, moving KV cache to CPU, switching KV cache precision, and pulling recent GLM-DSA indexer fixes. The user suspects an FP16 overflow in the DSA/indexer path and asks whether there is any workaround short of CPU-only inference.
More from Models
- Frontier models keep shipping so fast that no single model has a moat — 0xsachi · 2026-07-26
- A client project convinced one builder the agent harness matters more than the model — alexcovo_eth · 2026-07-26
- OpenAI’s GPT-6 and RSI rumors get a source map with internal compute and self-play clues — imjustnewatai · 2026-07-26
- OpenAI’s GPT-6 may be a memory-first system that helps train its successor — imjustnewatai · 2026-07-26
- Comparison post says Fable 5 is faster and cheaper than Opus 5 — bindureddy · 2026-07-26
- AREX, a recursive research agent, reportedly beats larger Qwen3.5 models in deep-research benchmarks — imjustnewatai · 2026-07-26