Nemotron 3.5 Bolt 74B A9B
Parameters
74B
Context Length
-
Modality
Text
Architecture
-
License
other
Release Date
7 Oct 2026
Knowledge Cutoff
-
API Pricing (per 1M)
Self-hosted only
System Requirements
VRAM requirements for different quantization methods and context sizes
1,024 tokens
Consumer
7x RTX 4090
24GB VRAM
Datacenter
2x NVIDIA A100
80GB VRAM
Apple Silicon
2x Apple M3 Max
128GB VRAM
131,072 tokens
Consumer
8x RTX 4090
24GB VRAM
Datacenter
3x NVIDIA A100
80GB VRAM
Apple Silicon
2x Apple M3 Max
128GB VRAM
Architecture Diagram
Evaluation Benchmarks
No evaluation benchmarks for Nemotron 3.5 Bolt 74B A9B available.
Rankings
Overall Rank
-
Coding Rank
-
About Nemotron 3.5 Bolt 74B A9B
Nemotron 3.5 Bolt 74B A9B is a high-speed multimodal MoE model engineered by NVIDIA for fast reasoning and visual comprehension within a 24GB memory footprint. It utilizes dynamic routing to activate 9B parameters per token for low-latency serving.
Technical Specifications
Resources
About Nemotron 3.5
NVIDIA's Nemotron 3.5 family of open models delivers leading efficiency and accuracy for agentic AI applications. Built on an advanced hybrid Mamba-2 SSM and sparse Mixture-of-Experts architecture with native Multi-Token Prediction (MTP) and speculative decoding harnesses, Nemotron 3.5 models are purpose-built for the high-volume execution layer of always-on agents.