Classification

Classification is the process of grouping or categorizing items into preset categories (or labels).

Types of Classification algorithms:

• Binary classification: predicting one of two classes
  • Algorithms:
    • Bernoulli Naive Bayes
    • Logistic Regression
    • Decision Trees
    • Perceptron
    • …
• Multi-class classification: predicting one of many classes
  • Algorithms:
    • Multinomial Naive Bayes
    • Decision Trees
    • k-Nearest Neighbors (KNN)
    • …
  • Strategies for using binary classification algorithms for multi-class classification:
    • One-vs-Rest(One-vs-all): splits a multi-class classification into one binary classification problem for each class
    • One-vs-one: splits a multi-class classification into one binary classification problem for each pair of classes.

Popular Algorithms:

• k-Nearest Neighbors (KNN)
• Logistic Regression
• Naive Bayes Classification
• Support Vector Machine (SVM)