Regression Regression Tasks

Linear Models generate a formula to find a best-fit line through a set of data points to predict unknown values.

Types of regressions:
Attributes of regression models:

  • Number of independent variables
    • Univariate: 1 feature or independent variables
    • Bivariate: 2 features or independent variables
    • Multivariate: more than 2 feature or independent variables
  • Shape of the regression
  • Type of dependent variables


  • Regression models are based on mathematical Regression Mathematics topic.
  • Random Forest can be utilized in regression tasks. Then the mean or average prediction of the individual trees is returned.
  • They can only be used to solve regression-based problems where a relationship between the dependent and independent variables must exist.
  • Regression models are highly interpretable and fast to train.
  • Regression is not robust in handling outliers and is also prone to overfitting. to address Overfitting in linear regression, Regularization (Technique) is used.
  • Based on degree of independent variable they are divided into:
  • MSE and MAE Loss Functions are used for regression tasks
  • Binary Crossentropy and categorical Crossentropy are used as Loss Functions for classification tasks using Logistic Regression