ApX logoApX logo

CogVideoX 1.5 5B

Parameters

5B

Modality

Video

Auxiliary Parameters

4.86B

Architecture

Diffusion Transformer

License

Apache 2.0

Release Date

15 Oct 2024

API Pricing (per 1M)

Self-hosted only

Hardware Sizing

Precision

Workload Memory: 5.32 GB

INT4 · 1024x1024

DiT Backbone Weights: 2.33 GB

VAE Decode Workspace: 0.49 GB

Runtime & Graphs: 2.50 GB

Minimum Required Hardware

1x NVIDIA L4 24GB

5.3 / 21.6 GB usable

1x RTX 3060 12GB

5.3 / 10.8 GB usable

Apple M4 24GB

5.3 / 18.0 GB usable

Determine requirements for your specific workload:

Open in VRAM Calculator

Architecture Diagram

Noisy Video Latents3D Spatio-Temporal VAE Latents3D Patch Embedding3D Spatio-Temporal PatchifyHidden: 3.1k · Text: 4.86B enc · Timestep (t)x 42 DiT blocksAdaLN ModulationNorm · Timestep scale/shiftSpatio-Temporal Attention48 headsHead dim: 64+AdaLN ModulationNorm · Timestep scale/shiftFeed-Forward (MLP)Activation+Final Norm (AdaLN Scale)Predicted Velocity (v)Denoised 3D Latents to VAE

About CogVideoX 1.5 5B

CogVideoX 1.5 5B extends the CogVideoX architecture to 10-second duration and 1080p resolution, incorporating improved attention pooling and longer temporal sequence lengths.

Technical Specifications

Attention

Attention Heads

48

Attention Head Dimension

64

Dimensions

Auxiliary Parameters

4.86B

Hidden Dimension Size

3,072

Number of Layers

42

About CogVideoX


Other CogVideoX Models
CogVideoX 1.5 5B - VRAM Requirements, Specs & Benchmarks