Grok 3
Parameters
-
Context Length
256K
Modality
Multimodal
Architecture
Dense
License
Proprietary
Release Date
15 Oct 2025
Knowledge Cutoff
-
Technical Specifications
Attention Structure
Multi-Head Attention
Hidden Dimension Size
-
Number of Layers
-
Attention Heads
-
Key-Value Heads
-
Activation Function
-
Normalization
-
Position Embedding
Absolute Position Embedding
Grok 3
Grok 3 represents xAI's advanced reasoning model trained on the Colossus supercomputer. Features real-time information integration from X platform, providing up-to-date knowledge and context. Excels at reasoning, coding, and creative tasks with xAI's distinctive direct and witty personality. Offers cutting-edge capabilities in information synthesis and analysis. Includes multimodal understanding and strong performance on technical benchmarks.
About Grok 3
xAI's Grok 3 series models trained on the massive Colossus supercomputer cluster. Features real-time information integration from X platform, advanced reasoning capabilities, and distinctive personality. Offers cutting-edge capabilities in reasoning and information synthesis.
Other Grok 3 Models
- No related models available
Evaluation Benchmarks
Rank
#54
| Benchmark | Score | Rank |
|---|---|---|
QA Assistant ProLLM QA Assistant | 0.97 | 4 |
Summarization ProLLM Summarization | 0.87 | 7 |
Graduate-Level QA GPQA | 0.85 | 11 |
Coding Aider Coding | 0.53 | 20 |
StackUnseen ProLLM Stack Unseen | 0.29 | 29 |
Professional Knowledge MMLU Pro | 0.80 | 31 |
Rankings
Overall Rank
#54
Coding Rank
#103