Objective function

it’s goal(objective) is optimize model by minimizing or maximizing the result of an evaluation function, I.e. loss or cost function.
- Loss Functions () computes the error for a single training example(measures the cost incurred from incorrect predictions).
- Cost Function () computes the error for entire training examples.
- Stochastic Gradient Descent(SGD): the aim is to minimize the Cost Function by incrementally changing the weights of the network.