ApX logo

GLM-4.5

Active Parameters

355B

Context Length

128K

Modality

Multimodal

Architecture

Mixture of Experts (MoE)

License

MIT License

Release Date

28 Jul 2025

Knowledge Cutoff

-

Technical Specifications

Total Expert Parameters

32.0B

Number of Experts

-

Active Experts

-

Attention Structure

Multi-Head Attention

Hidden Dimension Size

-

Number of Layers

-

Attention Heads

-

Key-Value Heads

-

Activation Function

-

Normalization

-

Position Embedding

Absolute Position Embedding

System Requirements

VRAM requirements for different quantization methods and context sizes

GLM-4.5

The GLM-4.5 model, developed by Z.ai (formerly Zhipu AI), represents their latest flagship hybrid reasoning model, designed to unify reasoning, coding, and agentic capabilities within a single architecture. This model is specifically optimized for agent-oriented applications, providing advanced functionalities for complex problem-solving. It is offered alongside a lighter variant, GLM-4.5-Air, which is optimized for efficiency while retaining core capabilities.

Architecturally, GLM-4.5 leverages a Mixture-of-Experts (MoE) design. It features a total of 355 billion parameters, with 32 billion active parameters utilized during a forward pass, aiming for higher parameter efficiency compared to other models. The model supports a dual reasoning approach, incorporating a "Thinking Mode" for intricate reasoning, multi-step planning, and tool usage, and a "Non-Thinking Mode" for rapid, instantaneous responses. This hybrid approach allows for flexibility in deployment, accommodating both deep analytical tasks and low-latency interactive scenarios.

GLM-4.5 is engineered for robust performance in domains such as tool invocation, web browsing, and software engineering, including both frontend and backend development. It supports native function calling and can be integrated into code-centric agents. The training regimen for GLM-4.5 involved an initial pretraining phase on 15 trillion tokens of general-domain data, followed by fine-tuning on an additional 7 trillion tokens focused on code and reasoning datasets. Reinforcement learning, specifically using Z.ai's custom-built 'slime' engine, was applied to further enhance its reasoning, coding, and agentic capabilities. The model is designed to handle extended conversational contexts, supporting a context length of 128,000 tokens and a maximum output token limit of 96,000 tokens.

About GLM Family

General Language Models from Z.ai


Other GLM Family Models

Evaluation Benchmarks

Ranking is for Local LLMs.

Rank

#6

BenchmarkScoreRank

LiveBench Average

LiveBench Average

0.62

🥇

1

0.82

🥈

2

Web Development

WebDev Arena

1363.3

🥈

2

Agentic Coding

LiveBench Agentic

0.23

🥉

3

0.66

6

0.70

9

0.60

10

Rankings

Overall Rank

#6

Coding Rank

#14

GPU Requirements

Full Calculator

Choose the quantization method for model weights

Context Size: 1,024 tokens

1k
63k
125k

VRAM Required:

Recommended GPUs