Tencent releases Hunyuan Hy4 preview: 770B MoE with 1M context
ShunyuYao12 · x · 2026-08-28
Tencent has released the Hunyuan Hy4 preview with the following key features:
- Specs: 770B total parameter MoE architecture with 49B active parameters and a 1M context window.
- Design: Built for real-world workloads like coding, document analysis, and scientific research, co-designed around actual workflows from Tencent engineers and WorkBuddy rather than just optimizing for benchmarks.
- Self-Optimization: Hy4 helped optimize its own training pipeline, including kernels.
- Availability: Free to use in WorkBuddy for the next two weeks.
GitHub repository and blog post are now available.
Related event: Tencent Open-Sources Hunyuan Hy4 Preview: 770B MoE with 1M Context(28 posts)→
More from Models
- Nathan Lambert slams Meta's Muse Open License as 'trash' — natolambert · 2026-10-16
- Google launches Gemini 4 Argon to Ultra and Pro subscribers, touting physics and 3D skills — ShikharMurty · 2026-10-16
- Google gives X users early access to test Argon, not just companies — lyraxana · 2026-10-16
- Grok Voice 3.0 Tops Design Arena Speech Leaderboard, Up 7.4 Points — XFreeze · 2026-10-16
- Robotics LLMs tested on 16 tasks: GPT-6 Astra hits 17.2% success vs Fable's 9.1% — pabbeel · 2026-10-16
- Meta open-sources Muse Spark: top US open model, scores just below DeepSeek — bindureddy · 2026-10-16