DiT-L/2 — the L backbone at patch 2.
Model Size
Parameters
pretrainedbool= FalseAccepted for signature parity with the rest of the zoo. No DiT
checkpoint ships here.
**overridesobject= {}Optional
DiTConfig field overrides.Returns
DiTModelThe denoising network.
Notes
Reference: Peebles and Xie, "Scalable Diffusion Models with Transformers", ICCV, 2023 (arXiv:2212.09748), Table 1 — 24 layers, hidden 1024, 16 heads.
Examples
>>> from lucid.models import dit_large_2
>>> config = dit_large_2().config
>>> config.depth, config.hidden_size, config.patch_size
(24, 1024, 2)