ApX logoApX logo

Granite 4.2 8B

Parameters

8B

Context Length

131K

Modality

Reasoning

Architecture

Dense

License

Apache 2.0

Release Date

7 Aug 2026

Knowledge Cutoff

-

API Pricing (per 1M)

Input: $0.06 · Output: $0.25

System Requirements

VRAM requirements for different quantization methods and context sizes

1,024 tokens

18.48 GB VRAM

Consumer

1x RTX 4090

24GB VRAM

Datacenter

1x NVIDIA A100

80GB VRAM

Apple Silicon

1x Apple M3 Max

128GB VRAM

131,072 tokens

40.85 GB VRAM

Consumer

2x RTX 4090

24GB VRAM

Datacenter

1x NVIDIA A100

80GB VRAM

Apple Silicon

1x Apple M3 Max

128GB VRAM

Architecture Diagram

Input TokensToken EmbeddingPosition: RoPEHidden: 4.1k · Context: 131K · Vocab: 100.4kx 40 layersRMSNormPre-AttentionGrouped-Query Attention32Q / 8KV headsHead dim: 128+RMSNormPre-FFNFeed-Forward NetworkSwiGLUIntermediate: 12.8k+Final RMSNormOutput Logits

Evaluation Benchmarks

Rank

#119

BenchmarkScoreRank

Professional Knowledge

MMLU Pro

0.74

36

Graduate-Level QA

GPQA

0.641

88

Agentic Index

Artificial Analysis

0.04

95

0.22

123

General Text

Text Arena

1342

125

Intelligence Index

Artificial Analysis

0.14

177

Rankings

Overall Rank

#119

Coding Rank

#109

About Granite 4.2 8B

Granite 4.2 8B is a dense reasoning model developed by IBM for enterprise and multi-step reasoning applications. It is tailored for mathematics, code generation, multilingual dialogue, and agentic workflows.

Technical Specifications

Attention

Attention Structure

Grouped-Query Attention

Attention Heads

32

Key-Value Heads

8

Attention Head Dimension

128

Position Embedding

ROPE

RoPE Theta

10,000,000

Sliding Window Attention

No

Sliding Window Size

-

Sliding Window Ratio

-

Linear Attention

No

Linear Attention Ratio

-

Normalization

RMS Normalization

Activation Function

SwigLU

Dimensions

Hidden Dimension Size

4,096

Number of Layers

40

FFN Intermediate Size (Dense)

12,800

Multi-Token Prediction Heads

-

Tokenizer

Vocabulary Size

100,352

About Granite

The Granite model family developed by IBM.


Other Granite Models
  • No related models available
Granite 4.2 8B: Specifications and GPU VRAM Requirements