ApX logoApX logo

MiniMax M2

Active Parameters

229B

Context Length

128K

Modality

Text

Architecture

Mixture of Experts

KV Cache Rate

128 KB/tok

License

MIT

Release Date

7 Nov 2025

Knowledge Cutoff

Jun 2024

API Pricing (per 1M)

Input: $0.30 · Output: $1.20

Hardware & System Requirements

Precision

Native

Context

Workload Memory: 448.67 GB

FP16 · 8K context

Base Weights: 445.17 GB

KV Cache: 1.00 GB

Runtime & Graphs: 2.50 GB

Minimum Required Hardware

8x NVIDIA H100 80GB

448.7 / 576.0 GB usable · TP 8

Determine requirements for your specific workload:

Open in VRAM Calculator

Runtime requirements

Checkpoint format

FP16

CUDA

>= 11.8

PyTorch

>= 2.1

Transformers

>= 4.57.1

ArchitecturePrecisionAttention kernel

Blackwell, Hopper

Native FP16

FlashAttention-3

Ada Lovelace, Ampere

Native FP16

FlashAttention-2

Architecture Diagram

Input TokensToken EmbeddingPosition: AbsoluteHidden: 4.1k · Context: 128K · Vocab: 200.1kx 32 layersRMSNormPre-AttentionMulti-Head Attention32Q / 8KV headsHead dim: 128+RMSNormPre-FFNSparse MoE FFN (2/8 experts)SwiGLUIntermediate: 1.5k+Final RMSNormOutput Logits

Evaluation Benchmarks

Rank

#126

BenchmarkScoreRank

Professional Knowledge

MMLU Pro

0.82

22

Software Engineering

SWE-bench Verified

0.61

25

Graduate-Level QA

GPQA

0.78

70

Web Development

WebDev Arena

1299

111

General Text

Text Arena

1344

151

Intelligence Index

Artificial Analysis

0.19

183

Rankings

Overall Rank

#126

Coding Rank

#111

About MiniMax M2

MiniMax M2 is a 229B Mixture-of-Experts transformer activating 10B parameters for high-throughput coding and autonomous agent workflows. It features structured reasoning traces and a 128K context window for continuous CI/CD integration.

Specifications

Attention

Attention Structure

Multi-Head Attention

Attention Heads

32

Key-Value Heads

8

Attention Head Dimension

128

Position Embedding

Absolute Position Embedding

RoPE Theta

5,000,000

Normalization

RMS Normalization

Activation Function

SwigLU

Dimensions

Base Precision

FP16

Hidden Dimension Size

4,096

Number of Layers

32

FFN Intermediate Size (Dense)

1,536

Multi-Token Prediction Heads

3

Tokenizer

Vocabulary Size

200,064

Mixture of Experts

Total Expert Parameters

10.0B

Number of Experts

8

Active Experts

2

FFN Intermediate Size (per Expert)

1,536

About MiniMax M2

MiniMax's efficient MoE models built for coding and agentic workflows.


Other MiniMax M2 Models
  • No related models available