Binary Step Activation Functions

This activation function compares the input value to a threshold value. if input value is greater than threshold, then output is 1; otherwise, 0.

  • It cannot provide multi-value outputs.
  • The step function’s gradient is zero, which makes the back propagation procedure difficult.