ApX 标志

趋近智

Command R

参数

35B

上下文长度

128K

模态

Text

架构

Dense

许可证

CC-BY-NC

发布日期

11 Mar 2024

知识截止

-

技术规格

注意力结构

Multi-Head Attention

隐藏维度大小

-

层数

-

注意力头

-

键值头

-

激活函数

-

归一化

Layer Normalization

位置嵌入

Absolute Position Embedding

系统要求

不同量化方法和上下文大小的显存要求

Command R

Cohere Command R is a generative language model optimized for enterprise-scale applications, particularly focusing on long-context tasks, retrieval-augmented generation (RAG), and multi-step tool use. It is designed to enable companies to move beyond proof-of-concept AI into production deployments by balancing efficiency with accuracy. The model offers strong capabilities across 10 major languages of global business, including English, French, Spanish, Italian, German, Portuguese, Japanese, Korean, Arabic, and Chinese, with its pre-training data also including many other languages to improve global versatility.

The architecture of Command R is based on an optimized Transformer design, allowing it to handle an extended context window of 128,000 tokens. This long context capability is crucial for processing extensive documents or multi-document conversations, ensuring coherent and contextually grounded responses. The model has been rigorously fine-tuned through supervised fine-tuning (SFT) on instruction-following data and preference tuning, similar to reinforcement learning from human feedback, to align its behavior with user expectations and enhance helpfulness and safety. Command R also features specialized training for grounded generation, allowing it to generate responses with citations from provided document snippets, a key component for robust RAG implementations.

Command R is engineered for practical enterprise use cases, excelling in tasks such as document summarization, question answering, and complex workflow automation. It supports both single-step and multi-step tool use, enabling interaction with external APIs, databases, or search engines. This functionality allows the model to perform actions and integrate with various internal and external systems. Furthermore, the model has demonstrated improved decision-making regarding tool utilization and the ability to follow instructions provided in system messages, along with enhanced structured data analysis.

关于 Command


其他 Command 模型

评估基准

排名适用于本地LLM。

排名

#49

基准分数排名

0.38

12

0.38

15

Agentic Coding

LiveBench Agentic

0.02

19

0.26

27

0.21

28

0.40

28

0.18

31

排名

排名

#49

编程排名

#40

GPU 要求

完整计算器

选择模型权重的量化方法

上下文大小:1024 个令牌

1k
63k
125k

所需显存:

推荐 GPU