ApX logoApX logo

MiMo-V2.6-Flash

Parameters

309B

Context Length

1.05M

Modality

Multimodal

Architecture

-

License

-

Release Date

21 Sept 2026

Knowledge Cutoff

-

API Pricing (per 1M)

Input: $0.14 · Output: $0.28

System Requirements

VRAM requirements for different quantization methods and context sizes

1,024 tokens

650.54 GB VRAM

Consumer

36x RTX 4090

24GB VRAM

Datacenter

10x NVIDIA A100

80GB VRAM

Apple Silicon

7x Apple M3 Max

128GB VRAM

1,048,576 tokens

794.71 GB VRAM

Consumer

44x RTX 4090

24GB VRAM

Datacenter

12x NVIDIA A100

80GB VRAM

Apple Silicon

9x Apple M3 Max

128GB VRAM

Architecture Diagram

Input TokensToken EmbeddingContext: 1.05Mx N layersNormPre-AttentionSelf-Attention+NormPre-FFNFeed-Forward NetworkActivation+Final NormOutput Logits

Evaluation Benchmarks

No evaluation benchmarks for MiMo-V2.6-Flash available.

Rankings

Overall Rank

-

Coding Rank

-

About MiMo-V2.6-Flash

MiMo-V2.6-Flash is an open-source multimodal mixture-of-experts foundation model developed by Xiaomi. With 309B total parameters activating 15B per token, it delivers high-efficiency performance across text, image, audio, and video inputs.

Technical Specifications

Attention

Attention Structure

-

Attention Heads

-

Key-Value Heads

-

Attention Head Dimension

-

Position Embedding

-

RoPE Theta

-

Sliding Window Attention

-

Sliding Window Size

-

Sliding Window Ratio

-

Linear Attention

-

Linear Attention Ratio

-

Normalization

-

Activation Function

-

Dimensions

Auxiliary Parameters

-

Hidden Dimension Size

-

Number of Layers

-

FFN Intermediate Size (Dense)

-

Multi-Token Prediction Heads

-

Tokenizer

Vocabulary Size

-

About MiMo V2

MiMo-V2-Flash is a Mixture-of-Experts (MoE) model with hybrid attention architecture designed for high-speed reasoning and agentic workflows. It features Multi-Token Prediction (MTP) to achieve state-of-the-art performance while significantly reducing inference costs. The model is optimized for long-context modeling and efficient inference.


Other MiMo V2 Models
MiMo-V2.6-Flash: Specifications and GPU VRAM Requirements