Parameters
35B
Context Length
128K
Modality
Text
Architecture
Dense
KV Cache Rate
160 KB/tok
License
CC-BY-NC
Release Date
11 Mar 2024
Knowledge Cutoff
Jun 2024
API Pricing (per 1M)
Input: $0.15 · Output: $0.60
Precision
Context
Workload Memory: 20.05 GB
INT4 · 8K context
Base Weights: 16.30 GB
KV Cache: 1.25 GB
Runtime & Graphs: 2.50 GB
1x NVIDIA L4 24GB
20.0 / 21.6 GB usable
2x RTX 4090 24GB
20.0 / 43.2 GB usable · TP 2
Apple M3 Pro 36GB
20.0 / 27.0 GB usable
Determine requirements for your specific workload:
Open in VRAM Calculator
Rank
#215
| Benchmark | Score | Rank |
|---|---|---|
General Text | 1227 | 180 |
Intelligence Index | 0.05 | 324 |
Overall Rank
#215
Coding Rank
-
Cohere Command R is a generative language model architected specifically for high-performance enterprise workloads, with an emphasis on long-context processing and tool-augmented workflows. Built on an optimized decoder-only Transformer framework, the model utilizes Grouped Query Attention (GQA) to maintain a significant 128,000-token context window while reducing the memory overhead typically associated with large-scale attention mechanisms. It is designed to facilitate the transition from experimental prototypes to production-grade deployments by offering a balance between inference efficiency and high-fidelity output.
The model undergoes a multi-stage training process including extensive pre-training on a diverse multilingual corpus and subsequent alignment via supervised fine-tuning and preference optimization. A defining architectural feature is its native training for grounded generation, which allows the model to produce responses with precise inline citations from external document sources. This makes it particularly effective for retrieval-augmented generation (RAG) pipelines, where maintaining factual consistency and source traceability is a primary requirement. Furthermore, Command R supports sophisticated multi-step tool use, enabling it to act as an agent that can reason through complex tasks by interacting with external APIs, databases, and software tools.
Optimized for global business applications, Command R provides native support for 10 languages and is trained on 23 in total, ensuring versatility across international markets. The architecture incorporates advanced components such as Rotary Positional Embeddings (RoPE) and Layer Normalization to ensure stability and coherence when handling massive input sequences. By focusing on practical utility in tasks like document summarization, complex reasoning, and structured data analysis, Command R serves as a scalable backbone for automated enterprise systems and intelligent agentic workflows.
Attention
Attention Structure
Multi-Head Attention
Attention Heads
64
Key-Value Heads
8
Position Embedding
Absolute Position Embedding
Normalization
Layer Normalization
Activation Function
SwigLU
Dimensions
Hidden Dimension Size
8,192
Number of Layers
40