Grok 3
Parameters
Undisclosed
Context Length
256K
Modality
Multimodal
Architecture
Undisclosed
License
Proprietary
Release Date
15 Oct 2025
Knowledge Cutoff
Nov 2024
API Pricing (per 1M)
Input: $4.00 · Output: $20.00
Evaluation Benchmarks
Rank
#107
| Benchmark | Score | Rank |
|---|---|---|
StackUnseen | 0.293 | 33 |
Graduate-Level QA | 0.846 | 45 |
General Text | 1411 | 88 |
Intelligence Index | 0.12 | 170 |
QA Assistant Archived | 0.967 | 4 |
Summarization Archived | 0.867 | 5 |
Coding Archived | 0.53 | 14 |
Rankings
Overall Rank
#107
Coding Rank
#121
About Grok 3
Grok 3 represents xAI's advanced reasoning model trained on the Colossus supercomputer. Features real-time information integration from X platform, providing up-to-date knowledge and context. Excels at reasoning, coding, and creative tasks with xAI's distinctive direct and witty personality. Offers cutting-edge capabilities in information synthesis and analysis. Includes multimodal understanding and strong performance on technical benchmarks.
Technical Specifications
Architecture specifications are undisclosed for proprietary models.
Attention
Attention Structure
Multi-Head Attention
Attention Heads
Undisclosed
Key-Value Heads
Undisclosed
Attention Head Dimension
Undisclosed
Position Embedding
Absolute Position Embedding
RoPE Theta
Undisclosed
Sliding Window Attention
Undisclosed
Sliding Window Size
Undisclosed
Sliding Window Ratio
Undisclosed
Linear Attention
Undisclosed
Linear Attention Ratio
Undisclosed
Normalization
Undisclosed
Activation Function
Undisclosed
Dimensions
Hidden Dimension Size
Undisclosed
Number of Layers
Undisclosed
FFN Intermediate Size (Dense)
Undisclosed
Multi-Token Prediction Heads
Undisclosed
Tokenizer
Vocabulary Size
Undisclosed
Resources
About Grok 3
xAI's Grok 3 series models trained on the massive Colossus supercomputer cluster. Features real-time information integration from X platform, advanced reasoning capabilities, and distinctive personality. Offers cutting-edge capabilities in reasoning and information synthesis.
Other Grok 3 Models
- No related models available