Tencent open-sources Hy4 preview, a 770B MoE flagship with 1M context
Tencent Hunyuan
Tencent's Hy team released Hy4 preview, a new-generation open-weights MoE model with 770B total and 49B activated parameters, a 1M-token context window, Gated DeepSeek Sparse Attention with cross-layer IndexCache, identity Hyper-Connections, and a native MTP layer for speculative decoding. Weights ship in BF16 and FP8 variants under Apache 2.0 on Hugging Face and ModelScope, with vLLM/SGLang recipes and an AngelSlim quantization toolkit.
Почему это важно
It puts Tencent at the open-source frontier alongside GLM-5.3 and Kimi K3 — an internal blind evaluation of 163 experts on 203 engineering tasks rated Hy4 preview slightly ahead of both (2.99 vs 2.92 and 2.94) — and it is the first open release at this scale built on gated sparse attention, targeting software engineering, data analysis, and research workloads.
Важность: 4/5
flagship open-weights release, official sources plus independent media confirmations