ApX logoApX logo

SVD Image-to-Video XT 1.1

Parameters

1.5B

Modality

Video

Auxiliary Parameters

80M

Architecture

Diffusion Transformer

License

Stability AI Community License

Release Date

1 Mar 2024

API Pricing (per 1M)

Self-hosted only

Hardware Sizing

Precision

Workload Memory: 3.25 GB

INT4 · 1024x1024

DiT Backbone Weights: 0.70 GB

VAE Decode Workspace: 0.05 GB

Runtime & Graphs: 2.50 GB

Minimum Required Hardware

1x NVIDIA L4 24GB

3.2 / 21.6 GB usable

1x RTX 3060 12GB

3.2 / 10.8 GB usable

Apple M4 24GB

3.2 / 18.0 GB usable

Determine requirements for your specific workload:

Open in VRAM Calculator

Architecture Diagram

Noisy Video Latents3D Spatio-Temporal VAE Latents3D Patch Embedding3D Spatio-Temporal PatchifyHidden: 1k · Text: 80M enc · Timestep (t)x 8 DiT blocksAdaLN ModulationNorm · Timestep scale/shiftSpatio-Temporal Attention20 headsHead dim: 64+AdaLN ModulationNorm · Timestep scale/shiftFeed-Forward (MLP)Activation+Final Norm (AdaLN Scale)Predicted Velocity (v)Denoised 3D Latents to VAE

About SVD Image-to-Video XT 1.1

SVD Image-to-Video XT 1.1 is a 1.5B parameter temporal UNet video model by Stability AI, generating 25 frames of smooth motion from a single still image conditioned on CLIP vision embeddings.

Technical Specifications

Attention

Attention Heads

20

Attention Head Dimension

64

Dimensions

Auxiliary Parameters

80M

Hidden Dimension Size

1,024

Number of Layers

8

About Stable Video Diffusion


Other Stable Video Diffusion Models