DeepSeek-V4-Flash
Active Parameters
284B
Context Length
1.05M
Modality
Text
Architecture
Mixture of Experts
KV Cache Rate
86 KB/tok
License
MIT
Release Date
24 Apr 2026
Knowledge Cutoff
-
API Pricing (per 1M)
Input: $0.30 · Output: $1.20
Hardware Sizing
Precision
Context
Workload Memory: 556.38 GB
FP16 · 8K context
Base Weights: 553.21 GB
KV Cache: 0.67 GB
Runtime & Graphs: 2.50 GB
Minimum Required Hardware
8x NVIDIA H100 80GB
556.4 / 576.0 GB usable · TP 8
Determine requirements for your specific workload:
Open in VRAM Calculator
Architecture Diagram
Evaluation Benchmarks
Rank
#58
| Benchmark | Score | Rank |
|---|---|---|
Professional Knowledge | 0.864 | 7 |
StackUnseen | 0.843 | 11 |
Data Analysis | 0.79 | 13 |
Agent Arena | high 0.02 | 26 |
Reasoning | 0.87 | 31 |
Web Development | high 1582 | 32 |
Graduate-Level QA | 0.874 | 35 |
Agentic Index | max 0.41 | 39 |
General | 0.74 | 39 |
LiveBench Average | 0.74 | 39 |
Agentic Coding | 0.47 | 45 |
Mathematics | 0.87 | 46 |
Coding | 0.75 | 49 |
Coding Index | max 0.56 high 0.52 | 74 84 |
General Text | 1436 | 81 |
Intelligence Index | 0.19 | 171 |
Rankings
Overall Rank
#58
Coding Rank
#52
About DeepSeek-V4-Flash
DeepSeek-V4-Flash is DeepSeek's fast, efficient, and economical MoE model in the V4 series, with 284B total parameters and 13B activated per token. Shares the same hybrid CSA+HCA attention architecture and 1M context support as V4-Pro. DeepSeek-V4-Flash-Max achieves comparable reasoning performance to V4-Pro when given a larger thinking budget. Strong on agentic and coding tasks (SWE-Bench Verified 79.0%, Terminal-Bench 2.0 56.9%), with smaller parameter scale enabling faster response times. Supports Non-think, Think High, and Think Max reasoning modes. Available via API as deepseek-v4-flash. Released open-source under MIT license on April 24, 2026.
Technical Specifications
Attention
Attention Structure
DeepSeek Sparse Attention
Attention Heads
64
Key-Value Heads
1
Attention Head Dimension
512
Position Embedding
Absolute Position Embedding
RoPE Theta
10,000
Sliding Window Attention
Yes
Sliding Window Size
128
Normalization
RMS Normalization
Activation Function
Swish
Dimensions
Hidden Dimension Size
4,096
Number of Layers
43
FFN Intermediate Size (Dense)
2,048
Multi-Token Prediction Heads
1
Tokenizer
Vocabulary Size
129,280
Mixture of Experts
Total Expert Parameters
13.0B
Number of Experts
256
Active Experts
6
Shared Experts
1
FFN Intermediate Size (per Expert)
2,048
About DeepSeek V4
DeepSeek-V4 is DeepSeek's latest generation of highly efficient Mixture-of-Experts language models, featuring a novel hybrid attention architecture combining Compressed Sparse Attention (CSA) and Heavily Compressed Attention (HCA) that dramatically improves long-context efficiency. Pre-trained on 32T+ tokens with a comprehensive post-training pipeline including domain-specific expert cultivation and unified model consolidation. Both V4-Pro and V4-Flash support 1M context length as standard, with three reasoning effort modes (Non-think, Think High, Think Max). Released open-source under MIT license on April 24, 2026.