relu

→Tensor

relu(input: Tensor)

Element-wise rectified linear unit.

Returns the positive part of each entry, zeroing out negatives.

inputTensor

Input tensor.

Tensor

Element-wise result with the same shape as input.

Mathematical definition:

\text{out}_i = \max(0, \text{input}_i)

Sub-gradient at $x = 0$ is conventionally taken as zero. Standard activation in CNNs / MLPs.

>>> import lucid
>>> x = lucid.tensor([1.0, 2.0, 3.0])
>>> lucid.relu(x)
Tensor([...])