Nemotron 3.5 Parse
Parameters
630M
Context Length
16K
Modality
Text
Architecture
Dense
License
openmdw-1.1
Release Date
3 Sept 2026
Knowledge Cutoff
-
API Pricing (per 1M)
Self-hosted only
System Requirements
VRAM requirements for different quantization methods and context sizes
1,024 tokens
Consumer
1x RTX 4090
24GB VRAM
Datacenter
1x NVIDIA A100
80GB VRAM
Apple Silicon
1x Apple M3 Max
128GB VRAM
16,384 tokens
Consumer
1x RTX 4090
24GB VRAM
Datacenter
1x NVIDIA A100
80GB VRAM
Apple Silicon
1x Apple M3 Max
128GB VRAM
Architecture Diagram
Evaluation Benchmarks
No evaluation benchmarks for Nemotron 3.5 Parse available.
Rankings
Overall Rank
-
Coding Rank
-
About Nemotron 3.5 Parse
Nemotron 3.5 Parse is a specialized foundation parser developed by NVIDIA for complex document understanding and structured information extraction. It leverages advanced prefix causal attention to process dense visual and textual documents.
Technical Specifications
Attention
Attention Structure
Grouped-Query Attention
Attention Heads
16
Key-Value Heads
8
Attention Head Dimension
64
Position Embedding
Absolute Position Embedding
Normalization
Layer Normalization
Activation Function
GELU
Dimensions
Hidden Dimension Size
1,024
Number of Layers
10
FFN Intermediate Size (Dense)
4,096
Multi-Token Prediction Heads
1
Tokenizer
Vocabulary Size
72,512
Resources
About Nemotron 3.5
NVIDIA's Nemotron 3.5 family of open models delivers leading efficiency and accuracy for agentic AI applications. Built on an advanced hybrid Mamba-2 SSM and sparse Mixture-of-Experts architecture with native Multi-Token Prediction (MTP) and speculative decoding harnesses, Nemotron 3.5 models are purpose-built for the high-volume execution layer of always-on agents.