Moonshot AI, released 2025-07-10. Sparse MoE decoder, 1T total, 32B active, 128K context. Attention: MLA.
Sparse MoEMoonshot AI 🇨🇳 · January 27, 2026
Kimi K2.5 (1T)
Native-multimodal Moonshot flagship that keeps the K2/DeepSeek-style MoE layout and pushes native context to 256k.
Key detail
Keeps the 384-expert K2 backbone, but adds multimodal capabilities (not shown) and doubles the native context length.Total params
1T
Active / token
32B
Context
256K
Fact sheet
- Scale
- 1T total, 32B active (3.2% active)
- Context window
- 256,000 tokens
- Decoder type
- Sparse MoE
- Attention
- MLA
- Layer mix
- 61 MLA
- KV cache / token (bf16)
- 68.6 KiB · Low
- License
- Modified MIT License
- Released
Efficiency
Parameters active per token
3.2%
32B of 1T weights run for each token.
AA Intelligence Index v4.3.2
Source19.4
- Scientific
- 6.9
Architecture concepts
Sources & resources
Use the ← and → keys to step through releases.
Similar architectures
Moonshot AI, released 2026-04-20. Sparse MoE decoder, 1T total, 32B active, 256K context. Attention: MLA.
Moonshot AI, released 2026-06-12. Sparse MoE decoder, 1T total, 32B active, 256K context. Attention: MLA.
Mistral AI, released 2026-10-29. Sparse MoE decoder, 1T total, 52B active, 1M context. Attention: MLA with modified DeepSeek Sparse Attention, index reuse, and KV sharing.