ApX logoApX logo

CogVideoX 2B

Parameters

2B

Modality

Video

Auxiliary Parameters

4.86B

Architecture

Diffusion Transformer

License

Apache 2.0

Release Date

6 Aug 2024

API Pricing (per 1M)

Self-hosted only

Hardware Sizing

Precision

Workload Memory: 3.67 GB

INT4 · 1024x1024

DiT Backbone Weights: 0.93 GB

VAE Decode Workspace: 0.23 GB

Runtime & Graphs: 2.50 GB

Minimum Required Hardware

1x NVIDIA L4 24GB

3.7 / 21.6 GB usable

1x RTX 3060 12GB

3.7 / 10.8 GB usable

Apple M4 24GB

3.7 / 18.0 GB usable

Determine requirements for your specific workload:

Open in VRAM Calculator

Architecture Diagram

Noisy Video Latents3D Spatio-Temporal VAE Latents3D Patch Embedding3D Spatio-Temporal PatchifyHidden: 1.9k · Text: 4.86B enc · Timestep (t)x 30 DiT blocksAdaLN ModulationNorm · Timestep scale/shiftSpatio-Temporal Attention30 headsHead dim: 64+AdaLN ModulationNorm · Timestep scale/shiftFeed-Forward (MLP)Activation+Final Norm (AdaLN Scale)Predicted Velocity (v)Denoised 3D Latents to VAE

About CogVideoX 2B

CogVideoX 2B is a lightweight 2B parameter video transformer by Zhipu AI, providing fast video generation on consumer GPUs with lower compute requirements.

Technical Specifications

Attention

Attention Heads

30

Attention Head Dimension

64

Dimensions

Auxiliary Parameters

4.86B

Hidden Dimension Size

1,920

Number of Layers

30

About CogVideoX


Other CogVideoX Models