swin_tiny¶

lucid.models.swin_tiny(img_size: int = 224, num_classes: int = 1000, **kwargs) → SwinTransformer¶

The swin_tiny function instantiates a small Swin Transformer model with a predefined architecture. This model leverages the shifted window mechanism to efficiently capture both local and global dependencies, making it suitable for image recognition and dense prediction tasks.

Total Parameters: 28,288,354

Function Signature¶

@register_model
def swin_tiny(img_size: int = 224, num_classes: int = 1000, **kwargs) -> SwinTransformer

Parameters¶

img_size (int, optional): The size of the input image (assumes square images). Default is 224.
num_classes (int, optional): The number of output classes for classification. Default is 1000.
kwargs (dict, optional): Additional parameters for customization, including:
- depths (list[int]): A list specifying the number of transformer blocks in each stage. The typical default configuration is [2, 2, 6, 2], indicating that the model has 4 stages with 2, 2, 6, and 2 blocks respectively.
- num_heads (list[int]): A list specifying the number of attention heads in each stage. The common default is [3, 6, 12, 24], corresponding to the number of heads used in each stage, which allows the model to capture multi-scale contextual information.

Returns¶

SwinTransformer: An instance of the SwinTransformer class configured as a lightweight vision transformer.

Examples¶

>>> import lucid.models as models
>>> model = models.swin_tiny()
>>> print(model)
SwinTransformer(img_size=224, num_classes=1000, ...)