Modules

Linear Layers

• Linear Layers
  • nn.Identity
  • nn.Flatten
  • nn.Linear
  • nn.Bilinear

Convolution Layers

• Convolution Layers
  • nn.Unfold
  • nn.Conv1d
  • nn.Conv2d
  • nn.Conv3d
  • nn.ConvTranspose1d
  • nn.ConvTranspose2d
  • nn.ConvTranspose3d

Activation Layers

• Activation Layers
  • nn.ReLU
  • nn.ReLU6
  • nn.LeakyReLU
  • nn.ELU
  • nn.SELU
  • nn.GELU
  • nn.Sigmoid
  • nn.HardSigmoid
  • nn.Tanh
  • nn.Softmax
  • nn.Swish
  • nn.HardSwish
  • nn.Mish

Pooling Layers

• Pooling Layers
  • nn.AvgPool1d
  • nn.AvgPool2d
  • nn.AvgPool3d
  • nn.MaxPool1d
  • nn.MaxPool2d
  • nn.MaxPool3d
  • nn.AdaptiveAvgPool1d
  • nn.AdaptiveAvgPool2d
  • nn.AdaptiveAvgPool3d
  • nn.AdaptiveMaxPool1d
  • nn.AdaptiveMaxPool2d
  • nn.AdaptiveMaxPool3d

Normalization Layers

• Normalization Layers
  • nn.BatchNorm1d
  • nn.BatchNorm2d
  • nn.BatchNorm3d
  • nn.InstanceNorm1d
  • nn.InstanceNorm2d
  • nn.InstanceNorm3d
  • nn.LayerNorm
  • nn.GroupNorm
  • nn.GlobalResponseNorm

Dropout Layers

• Dropout Layers
  • nn.Dropout
  • nn.Dropout1d
  • nn.Dropout2d
  • nn.Dropout3d
  • nn.AlphaDropout
  • nn.DropBlock
  • nn.DropPath

Loss Layers

• Loss Layers
  • nn.MSELoss
  • nn.BCELoss
  • nn.BCEWithLogitsLoss
  • nn.CrossEntropyLoss
  • nn.NLLLoss
  • nn.HuberLoss

Vision Layers

• Vision Layers
  • nn.Upsample

Sparse Layers

• Sparse Layers
  • nn.Embedding

Attention Layers

• Attention Layers
  • nn.ScaledDotProductAttention
  • nn.MultiHeadAttention

Transformer Layers

• Transformer Layers
  • nn.TransformerEncoderLayer
  • nn.TransformerDecoderLayer
  • nn.TransformerEncoder
  • nn.TransformerDecoder
  • nn.Transformer

Einops Layers

• Einops Layers
  • nn.Rearrange