Department of

Computer Engineering

Machine Learning
Sem 7

Supervised Learning 01CE0715

4 Credits

Unit #2 & 3

Prof. Urvi Bhatt

 After completion of this course, students will be able to

 Understand machine-learning concepts.

 Understand and implement Classification concepts.

Course
 Understand and analyse the different Regression
Outcomes
algorithms.

 Apply the concept of Unsupervised Learning.

 Apply the concepts of Artificial Neural Networks.

 Classification Techniques: Regression Techniques:
 Naive Bayes Classification  Basic concepts and
applications of Regression
 Fitting Multivariate Bernoulli
Distribution  Simple Linear Regression -
Gradient Descent and Normal
 Gaussian Distribution and
Equation Method
Multinomial Distribution
Topics -  K- Nearest Neighbours
 Multiple Linear Regression
Supervised  Decision tree
 Non-Linear Regression
Learning  Random Forest
 Linear Regression with
Regularization
 Ensemble Learning
 Overfitting and Underfitting
 Support Vector Machines
 Hyperparameter tuning
 Evaluation metrics for
 Evaluation Measures for
Classification Techniques:
Regression Techniques: MSE,
Confusion Matrix, Accuracy,
RMSE, MAE, R2
Precision, Recall, F1 Score,
Threshold, AUC-ROC
 Regression Techniques
(Continuous Data)
Supervised Learning
(Labeled Data) Classification
Techniques (Categorical
Machine Data)
Learning
Algorithms
Techniques
Clustering
Unsupervised
Learning (Unlabeled
Data)
Association Rule Mining
Supervised
Learning
 Normal Equation Method

Gradient Descent Lasso Regularization – L1

Simple Linear Regression
Method Regularization

Regression Multiple Linear Regularization & Ridge Regularization – L2

Techniques Regression Hyperparameter Tuning Regularization
Algorithms
(Continuous Elastic Net Regularization
Data) Quadratic Regression
– L1 and L2 Regularization
Non Linear Regression /
Cubic Regression
Polynomial Regression

nth degree Regression

 Binomial Logistic
Regression
Multinomial Logistic
Logistic Regression
Regression
Linear Models
Support Vector Ordinal Logistic
Machine (SVM) Regression
Classification K- Nearest
Techniques Neighbours (KNN)
(Categorical Multivariate Bernoulli
Algorithms
Data) Decision Tree
Distribution

Non-linear Naïve Bayes Gaussian Distribution

Models
Multinomial
Distribution
Random Forest
Ensemble Method
Gradient Boosting
 Performance Evaluation Measures
for Supervised Learning Algorithm

Regression Classification
Techniques Techniques
(Continuous Data) (Categorical Data)

Mean Absolute
Error (MAE) Confusion Recall / F1
Accuracy Precision Sensitivity/ True Score
Matrix
Mean Squared Positive Rate
Error (MSE)

Root Mean True Positive (TP)

Squared Error False AUC-
(RMSE) True Negative (TN) Threshold ROC
Positive
Rate (FPR)
R-squared
(Coefficient of False Positive (FP)
Determination)
(R2) False Negative (FN)
 Simple Linear
Multiple Regression Polynomial Regression
Regression
X / Input /
Independent 1 >=2 or >1 (Upto N ) 1
Variable
Y / Output / target
variable/
1 1 1
Dependent
Variable
Y = a0 + a1X + a2X2… + anxn
Line Equation Y = mX + c Y = a 0 + a1 X 1 + a 2 X 2 … + a n X n

Type of Line Polynomial Line Equation

Linear Line Equation Linear Line Equation
Equation with Degree n
No of Coefficient 1 =No of Input (i.e X) = No of Degree (n)
No of intersection
1 1 1
point

X Y X1 X2 Y X Y
Database
Any
Queries..?? Thank you