DeepSeek-R1 7B

Minimum Required Hardware

About DeepSeek-R1 7B

DeepSeek-R1 7B is a dense reasoning model distilled from DeepSeek-R1 onto the Qwen2.5-Math-7B foundation. It specializes in mathematical theorem proving, algorithmic problem solving, and structured logic over a 131K context window.

Technical Specifications

Resources

About DeepSeek-R1

DeepSeek-R1 is a model family developed for logical reasoning tasks. It incorporates a Mixture-of-Experts architecture for computational efficiency and scalability. The family utilizes Multi-Head Latent Attention and employs reinforcement learning in its training, with some variants integrating cold-start data.

Other DeepSeek-R1 Models

• DeepSeek-R1 1.5B
• DeepSeek-R1 3B
• DeepSeek-R1 8B
• DeepSeek-R1 14B
• DeepSeek-R1 32B
• DeepSeek-R1 70B
• DeepSeek-R1 671B