How far can quantization push large MoE models? Community weighs in after hy4 flash
UnfathomablecZoo · reddit · 2026-11-19
A Reddit user discusses quantization headroom for large MoE models. Tencent shared quantization work for hy4 preview, but no similar update has appeared since the full open weights (hy4 flash) dropped.
The post asks the r/LocalLLaMA community (ahead of Tencent's hy AMA) where the biggest efficiency gains remain:
- Better quantization methods
- Smarter memory management
- Architecture-level improvements
The open question: how far these techniques can be pushed while preserving model quality.
More from Infra
- Pi-Adapted Qwen3.8-27B Doubles Local Coding Pass Rate With 63% Fewer Tool Calls — yb2698 · 2026-11-19
- Eisman says the year's biggest AI IPO no longer matters — local data center fights do — Dan_Jeffries1 · 2026-11-19
- Neo4j shows how Change Data Capture can orchestrate AI agents from queryable state — JeremyCMorgan · 2026-11-19
- Nvidia booked $104B through its Singapore subsidiary in 2025, then stopped breaking it out — GaryMarcus · 2026-11-19
- Plenty of H200 GPUs available right now on Hugging Face Jobs — lhoestq · 2026-11-19
- Reddit rant: 0.02TPS isn't 'running' a 5T model, you're just boiling potatoes — eightone-81 · 2026-11-19