# xLSTM (7B)

> Recurrent 7B language model that replaces self-attention with xLSTM blocks built around matrix memory.

| Property | Value |
| --- | --- |
| Lab | NXAI (Austria) |
| Released | 2025-03-17 |
| Decoder type | Recurrent |
| Family | Recurrent |
| Scale | 7B parameters |
| Context window | No explicit limit tokens |
| Attention | No self-attention; mLSTM recurrent layers with matrix memory |
| Layer mix | 32 mLSTM |
| KV cache / token (bf16) | 0 B (No cache) |
| License | NXAI Community License Agreement |

**Key detail:** Stateful recurrent architecture aimed at fast long-context inference without an explicit context window.

## Links

- Architecture diagram: https://sebastianraschka.com/llm-architecture-gallery/images/architectures/xlstm-7b.webp
- config.json: https://huggingface.co/NX-AI/xLSTM-7b/blob/main/config.json
- License: https://huggingface.co/NX-AI/xLSTM-7b/blob/main/LICENSE
- Tech report: https://arxiv.org/abs/2503.13427
- Source card (source of truth): https://sebastianraschka.com/llm-architecture-gallery/#card-xlstm-7b
- Web page: https://llm-atlas-7or.pages.dev/models/xlstm-7b/
- JSON: https://llm-atlas-7or.pages.dev/api/models/xlstm-7b.json

_Data from Sebastian Raschka's LLM Architecture Gallery (https://sebastianraschka.com/llm-architecture-gallery/). Synced 2026-11-04._