趋近智
活跃参数
355B
上下文长度
128K
模态
Multimodal
架构
Mixture of Experts (MoE)
许可证
MIT License
发布日期
28 Jul 2025
知识截止
-
专家参数总数
32.0B
专家数量
-
活跃专家
-
注意力结构
Multi-Head Attention
隐藏维度大小
-
层数
-
注意力头
-
键值头
-
激活函数
-
归一化
-
位置嵌入
Absolute Position Embedding
不同量化方法和上下文大小的显存要求
The GLM-4.5 model, developed by Z.ai (formerly Zhipu AI), represents their latest flagship hybrid reasoning model, designed to unify reasoning, coding, and agentic capabilities within a single architecture. This model is specifically optimized for agent-oriented applications, providing advanced functionalities for complex problem-solving. It is offered alongside a lighter variant, GLM-4.5-Air, which is optimized for efficiency while retaining core capabilities.
Architecturally, GLM-4.5 leverages a Mixture-of-Experts (MoE) design. It features a total of 355 billion parameters, with 32 billion active parameters utilized during a forward pass, aiming for higher parameter efficiency compared to other models. The model supports a dual reasoning approach, incorporating a "Thinking Mode" for intricate reasoning, multi-step planning, and tool usage, and a "Non-Thinking Mode" for rapid, instantaneous responses. This hybrid approach allows for flexibility in deployment, accommodating both deep analytical tasks and low-latency interactive scenarios.
GLM-4.5 is engineered for robust performance in domains such as tool invocation, web browsing, and software engineering, including both frontend and backend development. It supports native function calling and can be integrated into code-centric agents. The training regimen for GLM-4.5 involved an initial pretraining phase on 15 trillion tokens of general-domain data, followed by fine-tuning on an additional 7 trillion tokens focused on code and reasoning datasets. Reinforcement learning, specifically using Z.ai's custom-built 'slime' engine, was applied to further enhance its reasoning, coding, and agentic capabilities. The model is designed to handle extended conversational contexts, supporting a context length of 128,000 tokens and a maximum output token limit of 96,000 tokens.
General Language Models from Z.ai
排名适用于本地LLM。
排名
#6
基准 | 分数 | 排名 |
---|---|---|
- | 0.62 | 🥇 1 |
Mathematics LiveBench Mathematics | 0.82 | 🥈 2 |
Web Development WebDev Arena | 1363.3 | 🥈 2 |
Agentic Coding LiveBench Agentic | 0.23 | 🥉 3 |
Data Analysis LiveBench Data Analysis | 0.66 | 6 |
Reasoning LiveBench Reasoning | 0.70 | 9 |
Coding LiveBench Coding | 0.60 | 10 |