GLM 5.3 Flash Inference Extremely Slow on Apple Silicon
CentrifugalMalaise · reddit · 2026-08-30
User tested the Unsloth quantized GLM 5.3 Flash model on an M2 Ultra Mac Pro, finding the time to first token intolerably slow at 3-4 minutes. In contrast, Qwen3.5 397B runs decently on the same hardware at around 23 tps. The user suspects inference engines have not yet optimized for GLM 5.3 Flash and seeks successful implementation examples on Apple Silicon.
More from Infra
- Autonomous sells personal AI computers from $26,100 that keep data in the room — dee_hw · 2026-10-15
- vLLM's bitwise-consistent RL: zero KL on Nemotron NVFP4, 91.3% throughput on DeepSeek-V4-Flash — DynamicWebPaige · 2026-10-15
- vLLM achieves bitwise-consistent RL training: DeepSeek-V4-Flash hits 0 diff over 100 steps — vllm_project · 2026-10-15
- vLLM Achieves Bitwise-Consistent RL Training, Fixing KL Blowups and Score Collapse — vllm_project · 2026-10-15
- Analyst Ben Bajarin: The AI Industry Needs a Lot More Compute — BenBajarin · 2026-10-15
- Next-gen GraalVM benchmarks: 4x faster startup, 2x less memory, no build step needed — RealGeneKim · 2026-10-15