Tencent Hunyuan open-sources Hy4: 770B-parameter MoE with 1M context
TencentHunyuan · x · 2026-11-20
Tencent's Hunyuan team has released the open weights of Hy4, its new natively multimodal flagship MoE model:
- Architecture: 770B total / 49B active parameters per token, 78 layers (dense FFN in layer 1, MoE FFNs in the remaining 77), supporting text, image, and video understanding with 1M context.
- Target capabilities: vision and computer use, frontend/game development, finance and office workflows, scientific research, and long-horizon personal assistance.
- Release package: System Card with a safety evaluation report, GitHub weights, GGUF quants, vLLM/SGLang support, finetuning scripts, and the DFly2 speculative decoding scheme.
- The team will host an AMA on r/LocalLLaMA this Friday, 8–10 AM PT.
Related event: Tencent Opensources Hunyuan Hy4, 770B Multimodal Flagship MoE(4 posts)→
More from Models
- Google silently disables logprobs on Gemini Hydrogen, Neon, Argon and Carbon models — dejanseo · 2026-11-20
- Bug Hunt chart: score vs subscription cost, Gemini 4 Neon xhigh tops at 63 for $1.80 — PawelHuryn · 2026-11-20
- Measured: Claude Max delivers 46.4x API value on Opus 5.5, beating ChatGPT Pro's 10.25x — PawelHuryn · 2026-11-20
- Dev complains GPT keeps skipping steps and ignoring instructions — lxfater · 2026-11-20
- GPT-6.2 Astra and Sol show OpenAI optimizes performance per dollar, not raw capability: analysis — VraserX · 2026-11-20
- Mamba+MoE hybrid reasoning model Olala-v1.0-mini-7A1B trends on Hugging Face — OVHaiLLM · 2026-11-20