RProp

RProp, short for Resilient Backpropagation, is a learning heuristic for Supervised Learning used in for full-batch Optimization of Feed-Forward Neural Networks (FFNN).

  • RProp is a first-order optimization algorithm.
  • RProp solves the problem that gradients may vary widely in magnitudes.
  • RProp is the basis of RMSprop algorithm.