Meta, released 2024-09-25. Dense decoder, 1B parameters, 128K context. Attention: GQA.
DenseCisco 🇺🇸 · July 21, 2026
Antares (1B)
Cisco Foundation AI's compact terminal agent uses a dense Granite 4.0 backbone and is post-trained with SFT and GRPO for vulnerability localization.
Key detail
Retains Granite 4.0's MuP scaling multipliers and tied input/output embeddings, then adds SFT and GRPO for terminal-based vulnerability localization.Parameters
1B
Context
128K
KV / token
80 KiB
Fact sheet
- Scale
- 1B parameters
- Context window
- 131,072 tokens
- Decoder type
- Dense
- Attention
- GQA with RoPE
- Layer mix
- 40 GQA
- KV cache / token (bf16)
- 80 KiB · Moderate
- License
- Apache License 2.0
- Released
Efficiency
Parameters active per token
100%
Dense: every weight runs for every token.
Architecture concepts
Sources & resources
Use the ← and → keys to step through releases.
Similar architectures
Alibaba Cloud, released 2025-04-28. Dense decoder, 600M parameters, 32K context. Attention: GQA.
Hugging Face, released 2025-06-19. Dense decoder, 3B parameters, 128K context. Attention: GQA with periodic NoPE layers.
Meta, released 2024-09-25. Dense decoder, 3B parameters, 128K context. Attention: GQA.