ApX 标志

趋近智

OLMo 3.1 32B Think

参数

32B

上下文长度

65.536K

模态

Text

架构

Dense

许可证

Apache 2.0

发布日期

12 Dec 2025

训练数据截止日期

Dec 2024

技术规格

注意力结构

Multi-Head Attention

隐藏维度大小

-

层数

64

注意力头

-

键值头

-

激活函数

-

归一化

-

位置嵌入

Absolute Position Embedding

系统要求

不同量化方法和上下文大小的显存要求

OLMo 3.1 32B Think

OLMo 3.1 32B Think, developed by the Allen Institute for AI, is a large-scale language model specifically engineered for advanced reasoning and multi-step problem-solving. This variant is a core component of the broader OLMo 3 family, distinguished by its focus on transparent, interpretable intelligence. The model is built upon a decoder-only Transformer architecture, a widely adopted framework in contemporary large language models, and is designed to facilitate detailed logical progression in its outputs.

The training methodology for OLMo 3.1 32B Think involves a multi-stage process that extends beyond foundational pretraining. Following initial pretraining on the extensive Dolma 3 dataset, the model undergoes supervised fine-tuning (SFT), direct preference optimization (DPO), and reinforcement learning from verifiable rewards (RLVR) using specialized Dolci-Think datasets. This post-training regimen is meticulously crafted to cultivate chain-of-thought reasoning capabilities, enabling the model to articulate its problem-solving steps explicitly. The architecture incorporates grouped-query attention to optimize computational efficiency, particularly for inference within single-GPU environments.

As a reasoning-oriented specialist, OLMo 3.1 32B Think demonstrates proficiency across a spectrum of demanding intellectual tasks, including advanced mathematics, complex coding challenges, and intricate logical inference. Its substantial context window supports analysis of extensive documents and multi-step analytical processes. The model's complete openness, encompassing not only its weights but also its training code, data, and detailed methodology, positions it as a robust platform for machine learning research and for applications requiring a verifiable and auditable artificial intelligence system.

关于 OLMo 3

OLMo (Open Language Model) is a series of fully open language models designed to enable the science of language models. Released by the Allen Institute for AI (Ai2), OLMo 3 provides complete access to training data (Dolma 3), code, checkpoints, logs, and evaluation methodologies. The family includes Base models for pretraining research, Instruct variants for chat and tool use, and Think variants with chain-of-thought reasoning capabilities. All models are trained with staged approach including pretraining, mid-training, and long-context phases.


其他 OLMo 3 模型

评估基准

排名适用于本地LLM。

没有可用的 OLMo 3.1 32B Think 评估基准。

排名

排名

-

编程排名

-

GPU 要求

完整计算器

选择模型权重的量化方法

上下文大小:1024 个令牌

1k
32k
64k

所需显存:

推荐 GPU

OLMo 3.1 32B Think: Specifications and GPU VRAM Requirements