Tencent open-sources Hy4 preview: 770B MoE with 1M context that helped train itself

aigclink · x · 2026-08-28

Tencent has open-sourced its new flagship Hy4 preview: a 770B-parameter MoE with 49B active parameters and 1M context, optimized for real work scenarios — coding, games, finance and scientific simulation.

The standout feature is a recursive self-improvement loop: for the first time, Hy4 preview participated in its own development, proposing improvements, running experiments, and adjusting training methods, data strategy and kernel optimization based on results.

The team stresses "upgrades, not price hikes" — the model is free in WorkBuddy for two weeks, with weights, blog and GitHub repo available.

Related event: Tencent Open-Sources Hunyuan Hy4 Preview: 770B MoE with 1M Context(10 posts)→

Original post →

More from Models

Models channel →