Learning Rate(

Notes:

- Large Learning Rate:
- Accelerates the training
- Can miss the minimum of Optimization function.

- Small Learning Rate:
- Slower training process.
- Can find precise minimum
- The solution can get stuck in a local minimum, stopping the weights to update.

- The learning rate controls how quickly the model is adapted to the problem.

Interactive Graph

Table Of Contents