Regression Mathematics

Regression Tasks deal with predicting the value of a dependent variable () from a set of independent variables () by create a model of the relationship between two.

In Linear regression with as regression intercept, as estimated regression slope(population slope coefficient), as the number of predictors, and for error in equation or residual we have:

  • Mathematical definition:
    • Simple linear regression(single variable):
    • multi-linear regression(multi variable):
    • Polynomial Regression: Concerning data points which do not fit a linear regression (a straight line through the points), the data may fit an polynomial regression(dependent variable() is modeled as an nth degree polynomial in ). Mathematical definition:


  • In statistics, a Regression is an approach to modeling a relationship between dependent variable() and independent variable().
  • In Machine Learning it’s done using Supervised Learning algorithms and is implemented as Regression Models.