ApX logo

Mistral Large 3

Active Parameters

41B

Context Length

256K

Modality

Multimodal

Architecture

Mixture of Experts (MoE)

License

Apache 2.0

Release Date

2 Dec 2025

Knowledge Cutoff

-

Technical Specifications

Total Expert Parameters

675.0B

Number of Experts

-

Active Experts

-

Attention Structure

Multi-Head Attention

Hidden Dimension Size

-

Number of Layers

-

Attention Heads

-

Key-Value Heads

-

Activation Function

-

Normalization

-

Position Embedding

Absolute Position Embedding

System Requirements

VRAM requirements for different quantization methods and context sizes

Mistral Large 3

Mistral Large 3 is a state-of-the-art, general-purpose multimodal model, characterized by its granular Mixture-of-Experts (MoE) architecture. The model incorporates 41 billion active parameters within a total parameter pool of 675 billion, representing a substantial computational capacity. It was trained from scratch using a cluster of 3000 NVIDIA H200 GPUs.

This variant is specifically an instruct-post-trained version, fine-tuned for instruction-following tasks. It is designed to excel in conversational AI, agentic functions, and other instruction-based use cases, making it suitable for deployment in production-grade assistants, retrieval-augmented generation (RAG) systems, scientific applications, and complex enterprise workflows. The model is engineered for reliability and robust long-context comprehension, supporting a context window of 256,000 tokens.

A key architectural component of Mistral Large 3 is its integrated 2.5 billion parameter Vision Encoder, enabling multimodal capabilities that allow the model to analyze images and derive insights from visual content alongside text. It offers strong multilingual support across dozens of languages, including major European and Asian languages. Furthermore, Mistral Large 3 demonstrates strong adherence to system prompts and provides best-in-class agentic capabilities, including native function calling and JSON output generation.

About Mistral Large 3

Mistral Large 3 is a state-of-the-art general-purpose multimodal model with a granular Mixture-of-Experts architecture. With 675B total parameters and 41B active parameters, it delivers frontier performance for production-grade assistants, retrieval-augmented systems, and complex enterprise workflows.


Other Mistral Large 3 Models
  • No related models available

Evaluation Benchmarks

Ranking is for Local LLMs.

No evaluation benchmarks for Mistral Large 3 available.

Rankings

Overall Rank

-

Coding Rank

-

GPU Requirements

Full Calculator

Choose the quantization method for model weights

Context Size: 1,024 tokens

1k
125k
250k

VRAM Required:

Recommended GPUs