StepLR

Step decay — multiply lr by $\gamma$ every step_size epochs.

Math

where $s$ is step_size and $\eta_0$ is base_lr_.

References

Classical staircase schedule used since AlexNet (Krizhevsky 2012).