ApX 标志

趋近智

OLMo 3 7B Instruct

参数

7B

上下文长度

65.536K

模态

Text

架构

Dense

许可证

Apache 2.0

发布日期

25 Oct 2025

训练数据截止日期

Dec 2024

技术规格

注意力结构

Multi-Head Attention

隐藏维度大小

-

层数

-

注意力头

-

键值头

-

激活函数

-

归一化

-

位置嵌入

Absolute Position Embedding

系统要求

不同量化方法和上下文大小的显存要求

OLMo 3 7B Instruct

OLMo 3 7B Instruct is an instruction-tuned variant developed by the Allen Institute for AI (AI2). It is optimized for chat, tool use, multi-turn dialogue, and function calling. This model is part of the broader OLMo 3 family, which aims to enable the scientific study of language models through complete transparency.

This model employs a Transformer-style autoregressive architecture with 7 billion parameters. Its post-training methodology includes supervised fine-tuning (SFT), Direct Preference Optimization (DPO), and Reinforcement Learning from Verifiable Rewards (RLVR) on the Dolci datasets. The base OLMo 3 models are initially trained on the Dolma 3 dataset, which integrates diverse text modalities such as web content, scientific publications, and code repositories, supporting a context length of up to 65,536 tokens.

OLMo 3 7B Instruct demonstrates capabilities in instruction-following, coding, and knowledge-based tasks. It is suitable for applications such as conversational AI systems, code development tools, and educational platforms. A defining aspect of the OLMo project is its transparency, offering public access to training data, model code, intermediate checkpoints, and training logs, which facilitates research and further development by the AI community.

关于 OLMo 3

OLMo (Open Language Model) is a series of fully open language models designed to enable the science of language models. Released by the Allen Institute for AI (Ai2), OLMo 3 provides complete access to training data (Dolma 3), code, checkpoints, logs, and evaluation methodologies. The family includes Base models for pretraining research, Instruct variants for chat and tool use, and Think variants with chain-of-thought reasoning capabilities. All models are trained with staged approach including pretraining, mid-training, and long-context phases.


其他 OLMo 3 模型

评估基准

排名适用于本地LLM。

没有可用的 OLMo 3 7B Instruct 评估基准。

排名

排名

-

编程排名

-

GPU 要求

完整计算器

选择模型权重的量化方法

上下文大小:1024 个令牌

1k
32k
64k

所需显存:

推荐 GPU