Mistral Large 3
Active Parameters
41B
Context Length
256K
Modality
Multimodal
Architecture
Mixture of Experts (MoE)
License
Apache 2.0
Release Date
2 Dec 2025
Knowledge Cutoff
Oct 2024
API Pricing (per 1M)
Input: $0.50 · Output: $1.50
System Requirements
VRAM requirements for different quantization methods and context sizes
1,024 tokens
Consumer
4x RTX 4090
24GB VRAM
Datacenter
2x NVIDIA A100
80GB VRAM
Apple Silicon
1x Apple M3 Max
128GB VRAM
256,000 tokens
Consumer
9x RTX 4090
24GB VRAM
Datacenter
3x NVIDIA A100
80GB VRAM
Apple Silicon
2x Apple M3 Max
128GB VRAM
Architecture Diagram
Evaluation Benchmarks
Rank
#128
| Benchmark | Score | Rank |
|---|---|---|
StackUnseen | 0.516 | 22 |
Web Development | 1230 | 85 |
General Text | 1413 | 89 |
Graduate-Level QA | 0.439 | 96 |
Agentic Index | 0.02 | 101 |
Coding Index | 0.20 | 117 |
Intelligence Index | 0.10 | 175 |
Rankings
Overall Rank
#128
Coding Rank
#96
About Mistral Large 3
Mistral Large 3 is Mistral AI's 675B flagship multimodal Mixture-of-Experts foundation model activating 41B parameters for enterprise RAG and agents. It features native vision processing, FP8/NVFP4 quantization, and a 256K token context window.
Technical Specifications
Attention
Attention Structure
Multi-Head Attention
Attention Heads
96
Key-Value Heads
8
Attention Head Dimension
128
Position Embedding
Absolute Position Embedding
RoPE Theta
1,000,000
Sliding Window Attention
No
Sliding Window Size
-
Sliding Window Ratio
-
Linear Attention
-
Linear Attention Ratio
-
Normalization
RMS Normalization
Activation Function
SwigLU
Dimensions
Hidden Dimension Size
12,288
Number of Layers
88
FFN Intermediate Size (Dense)
28,672
Multi-Token Prediction Heads
-
Tokenizer
Vocabulary Size
32,768
Mixture of Experts
Total Expert Parameters
675.0B
Number of Experts
16
Active Experts
2
Shared Experts
-
FFN Intermediate Size (per Expert)
-
Dense Layers Before MoE
-
About Mistral Large 3
Mistral Large 3 is a state-of-the-art general-purpose multimodal model with a granular Mixture-of-Experts architecture. With 675B total parameters and 41B active parameters, it delivers frontier performance for production-grade assistants, retrieval-augmented systems, and complex enterprise workflows.
Other Mistral Large 3 Models
- No related models available