CogVideoX 5B
Parameters
5B
Modality
Video
Auxiliary Parameters
4.86B
Architecture
Diffusion Transformer
License
Apache 2.0
Release Date
6 Aug 2024
API Pricing (per 1M)
Self-hosted only
Hardware Sizing
Precision
Workload Memory: 5.32 GB
INT4 · 1024x1024
DiT Backbone Weights: 2.33 GB
VAE Decode Workspace: 0.49 GB
Runtime & Graphs: 2.50 GB
Minimum Required Hardware
1x NVIDIA L4 24GB
5.3 / 21.6 GB usable
1x RTX 3060 12GB
5.3 / 10.8 GB usable
Apple M4 24GB
5.3 / 18.0 GB usable
Determine requirements for your specific workload:
Open in VRAM Calculator
Architecture Diagram
About CogVideoX 5B
CogVideoX 5B is a 3D spatio-temporal video diffusion transformer developed by Zhipu AI, utilizing a 3D VAE with 8x8x4 compression and expert transformer blocks for high-frame-rate coherence.
Technical Specifications
Attention
Attention Heads
48
Attention Head Dimension
64
Dimensions
Auxiliary Parameters
4.86B
Hidden Dimension Size
3,072
Number of Layers
42