Technical Specifications

System Requirements

VRAM requirements for different quantization methods and context sizes

Phi-4 Reasoning Plus

Microsoft's Phi-4 Reasoning Plus is a 14-billion parameter language model specifically optimized for complex reasoning tasks. It is an enhanced variant within the Phi-4 family, building upon the base Phi-4 model. The model's primary purpose is to address scenarios requiring long-chain reasoning, such as advanced mathematics, scientific inquiry, and code generation. Its development emphasizes delivering high-quality outputs even in computationally constrained environments.

The architecture of Phi-4 Reasoning Plus is a dense, decoder-only Transformer. It incorporates an extended context window of 32,000 tokens to facilitate processing of lengthy reasoning chains. The model utilizes rotary position embeddings to maintain coherence and track token positions effectively across extended sequences. Training involved supervised fine-tuning on a curated dataset of chain-of-thought traces, along with reinforcement learning to further enhance performance. This methodology focuses on high-quality synthetic and filtered organic data, ensuring proficiency in complex problem-solving.

Phi-4 Reasoning Plus demonstrates an increased latency compared to its counterpart, Phi-4 Reasoning, due to its generation of approximately 50% more tokens for more detailed responses. This characteristic makes it particularly suitable for high-accuracy tasks where comprehensive reasoning is paramount. The model is designed to operate efficiently on consumer-grade hardware, including mobile devices, tablets, and desktops, thereby expanding its accessibility for various AI applications.