InclusionAI, released 2026-10-13. Hybrid MoE decoder, 560B total, 25B active, 1M context. Attention: 7:1 Kimi Delta Attention and gated MLA.
Sparse hybridInclusionAI 🇨🇳 · April 23, 2026
Ling 2.6 (1T)
Ling 2.5 successor that keeps the Lightning Attention and MLA hybrid stack while adding an MTP layer for multi-token prediction.
Key detail
Keeps the 7:1 linear-attention/MLA ratio and adds one multi-token-prediction layer for speculative decoding.Total params
1T
Active / token
63B
Context
256K
Fact sheet
- Scale
- 1T total, 63B active (6.3% active)
- Context window
- 262,144 tokens
- Decoder type
- Sparse hybrid
- Attention
- Lightning Attention plus MLA
- Layer mix
- 10 MLA + 70 Lightning Attention + 1 MTP layer
- KV cache / token (bf16)
- 11.2 KiB · Very low
- License
- MIT License
- Released
Efficiency
Parameters active per token
6.3%
63B of 1T weights run for each token.
AA Intelligence Index v4.3.2
Source17
- Scientific
- 4.5
Architecture concepts
Sources & resources
Use the ← and → keys to step through releases.
Similar architectures
Z.ai, released 2026-08-26. Hybrid MoE decoder, 320B total, 18B active, 1M context. Attention: 3:1 Kimi Delta Attention and MLA with DeepSeek Sparse Attention.
InclusionAI, released 2026-08-04. Hybrid MoE decoder, 124B total, 5.1B active, 256K context. Attention: 5:1 Kimi Delta Attention and gated MLA.
InclusionAI, released 2026-02-15. Hybrid MoE decoder, 1T total, 63B active, 256K context. Attention: Lightning Attention plus MLA.