ApX logoApX logo

PixArt-α XL 2 1024-MS

Parameters

610M

Modality

Image

Auxiliary Parameters

4.78B

Architecture

Diffusion Transformer

License

Apache 2.0

Release Date

15 Nov 2023

API Pricing (per 1M)

Self-hosted only

Hardware Sizing

Precision

Workload Memory: 2.91 GB

INT4 · 1024x1024

DiT Backbone Weights: 0.28 GB

VAE Decode Workspace: 0.12 GB

Runtime & Graphs: 2.50 GB

Minimum Required Hardware

1x NVIDIA L4 24GB

2.9 / 21.6 GB usable

1x RTX 3060 12GB

2.9 / 10.8 GB usable

Apple M4 24GB

2.9 / 18.0 GB usable

Determine requirements for your specific workload:

Open in VRAM Calculator

Architecture Diagram

Noisy Image LatentsLatent Image Space (VAE)Patch Embedding2D Latent PatchifyHidden: 1.2k · Text: 4.78B enc · Timestep (t)x 28 DiT blocksAdaLN ModulationNorm · Timestep scale/shiftJoint / Cross-Attention16 headsHead dim: 72+AdaLN ModulationNorm · Timestep scale/shiftFeed-Forward (MLP)Activation+Final Norm (AdaLN Scale)Predicted Noise / LatentsDenoised Latents to VAE

About PixArt-α XL 2 1024-MS

PixArt-α is a 610M parameter diffusion transformer trained directly on T5 embeddings, matching larger diffusion models in image synthesis while significantly reducing training compute.

Technical Specifications

Attention

Attention Heads

16

Attention Head Dimension

72

Dimensions

Auxiliary Parameters

4.78B

Hidden Dimension Size

1,152

Number of Layers

28

About PixArt


Other PixArt Models