it’s goal(objective) is optimize model by minimizing or maximizing the result of an evaluation function, I.e. loss or cost function.
- Loss Functions (
- Cost Function (
- Stochastic Gradient Descent(SGD): the aim is to minimize the Cost Function by incrementally changing the weights of the network.