# Mistral Large 3 (673B)

> Mistral's new flagship effectively adopts the DeepSeek architecture and retunes the expert sizes.

| Property | Value |
| --- | --- |
| Lab | Mistral AI (France) |
| Released | 2025-12-02 |
| Decoder type | Sparse MoE |
| Family | Sparse MoE |
| Scale | 673B total, 41B active (6.1% active) |
| Context window | 262,144 tokens |
| Attention | MLA |
| Layer mix | 61 MLA |
| KV cache / token (bf16) | 68.6 KiB (Low) |
| License | Apache License 2.0 |

**Key detail:** Near-clone of DeepSeek V3 with larger experts, fewer routed experts, and multimodal support.

## Architecture concepts

- [Multi-Head Latent Attention (MLA)](https://llm-atlas-7or.pages.dev/concepts/mla.md): Keys and values are compressed into a small latent vector that is cached instead of full K/V.
- [Mixture of Experts (MoE)](https://llm-atlas-7or.pages.dev/concepts/moe.md): Many feed-forward experts, but a router sends each token to only a few of them.

## Benchmark (Artificial Analysis Intelligence Index)

- AA Intelligence Index v4.3.2: total 9.3 (General 17.1, Scientific 2.1, Coding 18.3, Agents 0.2)

## Links

- Architecture diagram: https://sebastianraschka.com/llm-architecture-gallery/images/architectures/mistral-3-large-673-billion.webp
- View in article: https://magazine.sebastianraschka.com/p/the-big-llm-architecture-comparison#%C2%A717-mistral-3-large
- params.json: https://huggingface.co/mistralai/Mistral-Large-3-675B-Instruct-2512/blob/main/params.json
- Source card (source of truth): https://sebastianraschka.com/llm-architecture-gallery/#card-mistral-large-3
- Web page: https://llm-atlas-7or.pages.dev/models/mistral-large-3/
- JSON: https://llm-atlas-7or.pages.dev/api/models/mistral-large-3.json

_Data from Sebastian Raschka's LLM Architecture Gallery (https://sebastianraschka.com/llm-architecture-gallery/). Synced 2026-11-04._