ELU (Exponential Linear Unit)

Exponential Linear Unit (ELU) introduces negative values and smoothness to address the limitations of traditional Activation Functions like ReLU (Rectified Linear Unit).

activation-functions-ELU.png